Sep 07 16:34:53 devstack cinder-volume[76513]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 16:34:53 devstack cinder-volume[76513]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:34:53 devstack cinder-volume[76513]: we strongly recommend against using it for new projects. Sep 07 16:34:53 devstack cinder-volume[76513]: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:34:53 devstack cinder-volume[76513]: framework. For more detail see Sep 07 16:34:53 devstack cinder-volume[76513]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:34:53 devstack cinder-volume[76513]: import eventlet # noqa Sep 07 16:34:55 devstack cinder-volume[76513]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:34:55 devstack cinder-volume[76513]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:34:55 devstack cinder-volume[76513]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:34:57 devstack cinder-volume[76513]: INFO dbcounter [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Registered counter for database cinder Sep 07 16:34:57 devstack cinder-volume[76513]: DEBUG oslo_db.sqlalchemy.engines [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:34:57 devstack cinder-volume[76513]: DEBUG dbcounter [-] [76513] Writer thread running {{(pid=76513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:34:57 devstack cinder-volume[76513]: INFO cinder.rpc [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 16:34:57 devstack cinder-volume[76513]: INFO cinder.rpc [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 16:34:57 devstack cinder-volume[76513]: DEBUG oslo_db.sqlalchemy.engines [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:34:57 devstack cinder-volume[76513]: INFO cinder.volume.manager [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Determined volume DB was empty at startup. Sep 07 16:34:57 devstack cinder-volume[76513]: DEBUG cinder.volume.manager [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76513) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 16:34:57 devstack cinder-volume[76513]: INFO cinder.volume.manager [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 16:34:57 devstack cinder-volume[76513]: WARNING stevedore.named [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:34:57 devstack cinder-volume[76513]: WARNING castellan.key_manager [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:34:57 devstack cinder-volume[76513]: WARNING cinder.keymgr.conf_key_mgr [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:34:57 devstack cinder-volume[76513]: DEBUG cinder.volume.drivers.lvm [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76513) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 16:34:57 devstack cinder-volume[76513]: DEBUG oslo_concurrency.processutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_concurrency.processutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] CMD "cinder-rtstool verify" returned: 0 in 0.443s {{(pid=76513) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_db.sqlalchemy.engines [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:34:58 devstack cinder-volume[76513]: INFO cinder.rpc [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 16:34:58 devstack cinder-volume[76513]: INFO cinder.rpc [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 16:34:58 devstack cinder-volume[76513]: WARNING stevedore.named [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:34:58 devstack cinder-volume[76513]: WARNING castellan.key_manager [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:34:58 devstack cinder-volume[76513]: INFO cinder.volume.manager [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_db.sqlalchemy.engines [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76513) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:34:58 devstack cinder-volume[76513]: INFO oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Starting 1 workers Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Started child 76679 {{(pid=76513) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Full set of CONF: {{(pid=76513) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] ******************************************************************************** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Configuration options gathered from: {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] ================================================================================ {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 16:34:58 devstack cinder-volume[76679]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] allow_availability_zone_fallback = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] allow_compression_on_image_upload = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] allowed_direct_url_schemes = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] api_rate_limit = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] auth_strategy = keystone {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] az_cache_duration = 3600 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_availability_zone = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_host = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_stats_polling_interval = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backup_api_class = cinder.backup.api.API {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backup_name_template = backup-%s {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backup_use_same_host = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backup_use_temp_snapshot = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] chap_password = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] chap_username = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_internal_tenant_project_id = bdccaf91f96c42ec969405de90280667 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_internal_tenant_user_id = a59ebaea5fd041d4bdf7dba7da667dec {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cloned_volume_same_az = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cluster = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] compression_format = gzip {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] compute_api_class = cinder.compute.nova.API {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] config_dir = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] config_source = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] control_exchange = openstack {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] debug = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] default_availability_zone = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] default_group_type = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] default_volume_type = lvmdriver-1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] disk_geometry = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] driver_client_cert = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] driver_client_cert_key = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] driver_data_namespace = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] driver_ssl_cert_path = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] driver_ssl_cert_verify = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] driver_use_ssl = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] enable_force_upload = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] enable_new_services = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] enable_unsupported_driver = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] enabled_backends = ['lvmdriver-1'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] enforce_multipath_for_image_xfer = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] filter_function = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_api_insecure = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_api_ssl_compression = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_ca_certificates_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_catalog_info = image:glance:publicURL {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_num_retries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance_request_timeout = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] goodness_function = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] graceful_shutdown_timeout = 5 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] group_api_class = cinder.group.api.API {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] host = devstack {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_compress_on_upload = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_conversion_address_space_limit = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_conversion_cpu_limit = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76679]: INFO cinder.volume.manager [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_conversion_disable = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_upload_use_cinder_backend = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_upload_use_internal_tenant = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_volume_cache_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_volume_cache_max_count = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] image_volume_cache_max_size_gb = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] init_host_max_objects_retrieval = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] instance_format = [instance: %(uuid)s] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] iscsi_target_flags = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] iscsi_write_cache = on {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] iser_helper = tgtadm {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] iser_ip_address = 192.168.122.91 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] iser_port = 3260 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_color = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_config_append = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_dir = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_options = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_rotate_interval = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_rotate_interval_type = days {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] log_rotation_type = none {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] max_age = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] max_logfile_count = 30 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] max_logfile_size_mb = 200 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] max_over_subscription_ratio = 20.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] message_reap_interval = 86400 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] message_ttl = 2592000 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] migration_create_volume_timeout_secs = 300 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] monkey_patch = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] monkey_patch_modules = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] my_ip = 192.168.122.91 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] no_snapshot_gb_quota = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] num_iser_scan_tries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] num_shell_tries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] num_volume_device_scan_tries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] nvmeof_conn_info_version = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] nvmet_ns_id = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] nvmet_port_id = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] osapi_max_limit = 1000 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] osapi_volume_ext_list = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] osapi_volume_listen = 0.0.0.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] osapi_volume_listen_port = 8776 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] osapi_volume_use_ssl = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] osapi_volume_workers = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] per_volume_size_limit = -1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] periodic_fuzzy_delay = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] periodic_interval = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] project_id_regex = [0-9a-f\-]+ {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] public_endpoint = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] publish_errors = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] quota_backup_gigabytes = 1000 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] quota_backups = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] quota_gigabytes = 1000 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] quota_groups = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] quota_snapshots = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] quota_volumes = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] rate_limit_burst = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] rate_limit_except_level = CRITICAL {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] rate_limit_interval = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] reinit_driver_count = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] replication_device = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] report_discard_supported = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] report_interval = 120 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] reservation_clean_interval = 86400 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] reservation_expire = 86400 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] reserved_image_namespaces = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] reserved_percentage = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] rpc_response_timeout = 120 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] run_external_periodic_tasks = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] scst_target_driver = iscsi {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] scst_target_iqn_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_down_time = 720 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] shell_completion = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] snapshot_name_template = snapshot-%s {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] snapshot_same_host = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] split_loggers = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] state_path = /opt/stack/data/cinder {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] storage_availability_zone = nova {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] storage_protocol = iSCSI {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] syslog_log_facility = LOG_USER {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] target_helper = lioadm {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] target_ip_address = 192.168.122.91 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] target_port = 3260 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] target_protocol = iscsi {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] target_secondary_ip_addresses = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] trace_flags = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] transfer_api_class = cinder.transfer.api.API {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] transport_url = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] until_refresh = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] use_chap_auth = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] use_default_quota_class = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] use_journal = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] use_json = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] use_multipath_for_image_xfer = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] use_stderr = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] use_syslog = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] verify_glance_signatures = enabled {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_api_class = cinder.volume.api.API {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_backend_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_clear = zero {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_clear_ionice = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_clear_size = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_copy_bps_limit = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_dd_blocksize = 1M {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_name_template = volume-%s {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_service_inithost_offload = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volume_usage_audit_period = month {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] zoning_mode = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_concurrency.disable_process_locking = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.auth_section = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.auth_type = password {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.auth_version = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.cache = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.delay_auth_decision = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.http_connect_timeout = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.include_service_catalog = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.insecure = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.interface = public {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_password = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcache_username = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.region_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.service_token_roles_required = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.service_type = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.token_cache_time = 300 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.backend = dogpile.cache.null {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.backend_argument = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.backend_expiration_time = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.config_prefix = cache.oslo {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.debug_cache_backend = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.enable_retry_client = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.enable_socket_keepalive = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.expiration_time = 600 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.hashclient_retry_attempts = 2 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.memcache_dead_retry = 300 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.memcache_pool_maxsize = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.memcache_sasl_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.password = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.proxies = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.redis_db = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.redis_sentinel_service_name = mymaster {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.redis_server = localhost:6379 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.retry_attempts = 2 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.retry_delay = 0.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.socket_keepalive_count = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.socket_keepalive_idle = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.socket_keepalive_interval = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.socket_timeout = 1.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.tls_allowed_ciphers = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.tls_cafile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.tls_certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.tls_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.tls_keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cache.username = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] coordination.backend_url = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.asyncio_connection = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.asyncio_slave_connection = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.backend = sqlalchemy {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.connection = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.connection_debug = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.connection_parameters = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.connection_recycle_time = 3600 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.connection_trace = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.db_inc_retry_interval = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.db_max_retries = 20 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.db_max_retry_interval = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.db_retry_interval = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.max_overflow = 50 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.max_pool_size = 5 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.max_retries = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.mysql_wsrep_sync_wait = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.pool_timeout = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.retry_interval = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.slave_connection = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.sqlite_synchronous = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.synchronous_reader = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] database.use_db_reconnect = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_tracing.insecure = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.connection_string = messaging:// {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.es_doc_type = notification {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.es_scroll_size = 10000 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.es_scroll_time = 2m {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.filter_error_trace = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.hmac_keys = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.sentinel_service_name = mymaster {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.socket_timeout = 0.1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:58 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.trace_requests = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler.trace_sqlalchemy = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler_jaeger.process_tags = {} {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler_jaeger.service_name_prefix = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] profiler_otlp.service_name_prefix = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.enforce_new_defaults = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.policy_default_rule = default {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.policy_file = policy.yaml {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_policy.remote_timeout = 60.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] privsep_osbrick.group = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] privsep_osbrick.helper_command = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] privsep_osbrick.user = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_sys_admin.group = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_sys_admin.helper_command = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] cinder_sys_admin.user = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.auth_section = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.auth_type = password {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.cafile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.collect_timing = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.insecure = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.send_service_user_token = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.split_loggers = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.timeout = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack sudo[76742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.tls_ciphers = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] service_user.tls_min_version = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.auth_section = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.auth_type = password {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.collect_timing = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.insecure = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.region_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.split_loggers = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.timeout = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.tls_ciphers = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] glance.tls_min_version = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.backend_availability_zone = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.chap_password = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.chap_username = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.disk_geometry = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.driver_client_cert = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.driver_client_cert_key = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.driver_data_namespace = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.driver_use_ssl = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.enable_unsupported_driver = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.extra_capabilities = {} {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.filter_function = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.goodness_function = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.iscsi_target_flags = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.iscsi_write_cache = on {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.iser_helper = tgtadm {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.iser_port = 3260 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.lvm_mirrors = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.lvm_share_target = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.lvm_type = auto {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.num_shell_tries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.nvmet_port_id = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.replication_device = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.report_discard_supported = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.reserved_percentage = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.scst_target_driver = iscsi {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.scst_target_iqn_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.storage_protocol = iSCSI {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.target_helper = tgtadm {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.target_port = 3260 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.target_protocol = iscsi {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.trace_flags = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.unique_fqdn_network = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.use_chap_auth = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_backend_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_clear = zero {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_clear_ionice = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_clear_size = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volume_group = cinder-volumes {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_reports.file_event_handler = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_reports.log_dir = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.backend_availability_zone = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.backend_host = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.chap_password = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.chap_username = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.chiscsi_conf = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.disk_geometry = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.driver_client_cert = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.driver_data_namespace = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.driver_use_ssl = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.extra_capabilities = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.filter_function = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.goodness_function = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.iser_helper = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.iser_ip_address = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.iser_port = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.iser_target_prefix = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.lvm_conf_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.lvm_mirrors = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.lvm_share_target = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.lvm_type = auto {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.num_shell_tries = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.nvmet_port_id = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.replication_device = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.report_discard_supported = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.reserved_percentage = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.scst_target_driver = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.storage_protocol = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.target_helper = lioadm {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.target_ip_address = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.target_port = 3260 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.target_protocol = iscsi {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.trace_flags = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.use_chap_auth = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_clear = zero {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_clear_size = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] lvmdriver-1.volumes_dir = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.ssl = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.ssl_version = {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_notifications.driver = [] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_notifications.retry = -1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] oslo_messaging_notifications.transport_url = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] key_manager.fixed_key = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.barbican_api_version = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.barbican_endpoint = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.barbican_endpoint_type = public {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.barbican_region_name = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.cafile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.collect_timing = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.insecure = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.number_of_retries = 60 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.retry_delay = 1 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.send_service_user_token = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.split_loggers = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.timeout = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.tls_ciphers = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.tls_min_version = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.verify_ssl = True {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican.verify_ssl_path = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.auth_section = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.auth_type = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.cafile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.certfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.collect_timing = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.insecure = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.keyfile = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.split_loggers = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.timeout = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.tls_ciphers = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] barbican_service_user.tls_min_version = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.approle_role_id = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.approle_secret_id = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.auth_method = approle {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.auth_path = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.kv_mountpoint = secret {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.kv_path = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.kv_version = 2 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.namespace = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.root_token_id = **** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.ssl_ca_crt_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.timeout = 60.0 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.token_file = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.token_role = None {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.use_ssl = False {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:34:58 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] ******************************************************************************** {{(pid=76513) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 16:34:59 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:59 devstack sudo[76857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:34:59 devstack sudo[76857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:34:59 devstack sudo[76857]: pam_unix(sudo:session): session closed for user root Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.319s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:34:59 devstack cinder-volume[76679]: INFO cinder.brick.local_dev.lvm [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:59 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:34:59 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:34:59 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG cinder.brick.local_dev.lvm [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76679) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 16:34:59 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:34:59 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:34:59 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:00 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.535s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:00 devstack sudo[77203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:35:00 devstack sudo[77203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:00 devstack sudo[77203]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.365s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:00 devstack sudo[77283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 16:35:00 devstack sudo[77283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:00 devstack sudo[77283]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.365s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:00 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:00 devstack sudo[77367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:35:00 devstack sudo[77367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:01 devstack sudo[77367]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:01 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:01 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:01 devstack sudo[77370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:35:01 devstack sudo[77370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:01 devstack sudo[77370]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:01 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:01 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:01 devstack sudo[77426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:35:01 devstack sudo[77426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:01 devstack sudo[77426]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:01 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:01 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:01 devstack sudo[77466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:35:01 devstack sudo[77466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:02 devstack sudo[77466]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:02 devstack sudo[77470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:35:02 devstack sudo[77470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:02 devstack sudo[77470]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:02 devstack cinder-volume[76679]: INFO cinder.volume.drivers.lvm [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:02 devstack sudo[77480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:35:02 devstack sudo[77480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:02 devstack sudo[77480]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG cinder.volume.drivers.lvm [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Updating volume stats {{(pid=76679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:35:02 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:02 devstack sudo[77483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:35:02 devstack sudo[77483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:03 devstack sudo[77483]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:03 devstack sudo[77486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:35:03 devstack sudo[77486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:03 devstack sudo[77486]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:03 devstack sudo[77489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:35:03 devstack sudo[77489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:03 devstack sudo[77489]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:03 devstack sudo[77492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:35:03 devstack sudo[77492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:03 devstack sudo[77492]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:03 devstack cinder-volume[76679]: INFO cinder.volume.driver [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Driver hasn't implemented _init_vendor_properties() Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG cinder.volume.driver [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76679) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 16:35:03 devstack cinder-volume[76679]: DEBUG oslo_db.sqlalchemy.engines [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76679) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG dbcounter [-] [76679] Writer thread running {{(pid=76679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG cinder.db.api [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Building query based on filter {{(pid=76679) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG cinder.image.image_utils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76679) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 16:35:04 devstack cinder-volume[76679]: INFO cinder.keymgr.migration [None req-c682d64e-e196-49c8-a8be-b9b42bc5399a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG cinder.volume.drivers.lvm [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Updating volume stats {{(pid=76679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:04 devstack sudo[77497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:35:04 devstack sudo[77497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:04 devstack sudo[77497]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:04 devstack sudo[77500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:35:04 devstack sudo[77500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:04 devstack sudo[77500]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:04 devstack sudo[77504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:35:04 devstack sudo[77504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:04 devstack sudo[77504]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:04 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:04 devstack sudo[77507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:35:04 devstack sudo[77507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:05 devstack sudo[77507]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG cinder.manager [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Notifying Schedulers of capabilities ... {{(pid=76679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:35:05 devstack cinder-volume[76679]: INFO cinder.volume.manager [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Driver initialization completed successfully. Sep 07 16:35:05 devstack cinder-volume[76679]: INFO cinder.manager [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Initiating service 2 cleanup Sep 07 16:35:05 devstack cinder-volume[76679]: INFO cinder.manager [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Service 2 cleanup completed. Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG cinder.service [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Creating RPC server for service cinder-volume {{(pid=76679) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG cinder.service [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76679) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 16:35:05 devstack cinder-volume[76679]: INFO cinder.volume.manager [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG cinder.volume.drivers.lvm [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Updating volume stats {{(pid=76679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:05 devstack sudo[77512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:35:05 devstack sudo[77512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:05 devstack sudo[77512]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:05 devstack sudo[77518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:35:05 devstack sudo[77518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:05 devstack sudo[77518]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:05 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:05 devstack sudo[77521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:35:05 devstack sudo[77521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:06 devstack sudo[77521]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:06 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:06 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:35:06 devstack sudo[77524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:35:06 devstack sudo[77524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:35:06 devstack sudo[77524]: pam_unix(sudo:session): session closed for user root Sep 07 16:35:06 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:35:06 devstack cinder-volume[76679]: INFO cinder.volume.manager [None req-8c990038-ea80-4fc1-b7f5-63e1ee053bfc None None] Driver post RPC initialization completed successfully. Sep 07 16:35:08 devstack cinder-volume[76513]: DEBUG dbcounter [-] [76513] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76513) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:35:16 devstack cinder-volume[76679]: DEBUG dbcounter [-] [76679] Writing DB stats cinder:SELECT=3 {{(pid=76679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:35:16 devstack cinder-volume[76679]: DEBUG dbcounter [-] [76679] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:35:35 devstack cinder-volume[76679]: DEBUG oslo_service.periodic_task [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running periodic task VolumeManager._thread_info {{(pid=76679) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:35:35 devstack cinder-volume[76679]: DEBUG cinder.volume.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] thread count: 6 {{(pid=76679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:35:35 devstack cinder-volume[76679]: DEBUG cinder.volume.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] thread info: [<_MainThread(MainThread, started 133066386571392)>, , , , , ] {{(pid=76679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:36:35 devstack cinder-volume[76679]: DEBUG oslo_service.periodic_task [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76679) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:36:35 devstack cinder-volume[76679]: DEBUG cinder.volume.drivers.lvm [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Updating volume stats {{(pid=76679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:36:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:36:35 devstack sudo[80196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:36:35 devstack sudo[80196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:36:35 devstack sudo[80196]: pam_unix(sudo:session): session closed for user root Sep 07 16:36:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:36:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:36:35 devstack sudo[80199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:36:35 devstack sudo[80199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:36:35 devstack sudo[80199]: pam_unix(sudo:session): session closed for user root Sep 07 16:36:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:36:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:36:35 devstack sudo[80202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:36:35 devstack sudo[80202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:36:36 devstack sudo[80202]: pam_unix(sudo:session): session closed for user root Sep 07 16:36:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:36:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:36:36 devstack sudo[80205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:36:36 devstack sudo[80205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:36:36 devstack sudo[80205]: pam_unix(sudo:session): session closed for user root Sep 07 16:36:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:36:36 devstack cinder-volume[76679]: DEBUG cinder.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Notifying Schedulers of capabilities ... {{(pid=76679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:36:36 devstack cinder-volume[76679]: DEBUG oslo_service.periodic_task [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running periodic task VolumeManager._thread_info {{(pid=76679) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:36:36 devstack cinder-volume[76679]: DEBUG cinder.volume.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] thread count: 6 {{(pid=76679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:36:36 devstack cinder-volume[76679]: DEBUG cinder.volume.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] thread info: [<_MainThread(MainThread, started 133066386571392)>, , , , , ] {{(pid=76679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:37:16 devstack cinder-volume[76679]: DEBUG dbcounter [-] [76679] Writing DB stats cinder:SELECT=1 {{(pid=76679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:37:16 devstack cinder-volume[76679]: DEBUG dbcounter [-] [76679] Writing DB stats cinder:UPDATE=1 {{(pid=76679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:37:35 devstack cinder-volume[76679]: DEBUG oslo_service.periodic_task [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76679) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:37:35 devstack cinder-volume[76679]: DEBUG cinder.volume.drivers.lvm [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Updating volume stats {{(pid=76679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:37:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:37:35 devstack sudo[83814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:37:35 devstack sudo[83814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:37:35 devstack sudo[83814]: pam_unix(sudo:session): session closed for user root Sep 07 16:37:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:37:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:37:35 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:37:35 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:37:35 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Sep 07 16:37:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:37:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:37:36 devstack sudo[83820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:37:36 devstack sudo[83820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:37:36 devstack sudo[83820]: pam_unix(sudo:session): session closed for user root Sep 07 16:37:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:37:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:37:36 devstack sudo[83823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:37:36 devstack sudo[83823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:37:36 devstack sudo[83823]: pam_unix(sudo:session): session closed for user root Sep 07 16:37:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:37:36 devstack cinder-volume[76679]: DEBUG cinder.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Notifying Schedulers of capabilities ... {{(pid=76679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:38:35 devstack cinder-volume[76679]: DEBUG oslo_service.periodic_task [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76679) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:38:35 devstack cinder-volume[76679]: DEBUG cinder.volume.drivers.lvm [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Updating volume stats {{(pid=76679) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:38:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:38:35 devstack sudo[85532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:38:35 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:38:35 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root Sep 07 16:38:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:38:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:38:35 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:38:35 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:38:35 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Sep 07 16:38:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:38:35 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:38:36 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:38:36 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:38:36 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Sep 07 16:38:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:38:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:38:36 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:38:36 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:38:36 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Sep 07 16:38:36 devstack cinder-volume[76679]: DEBUG oslo_concurrency.processutils [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76679) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:38:36 devstack cinder-volume[76679]: DEBUG cinder.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Notifying Schedulers of capabilities ... {{(pid=76679) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:38:36 devstack cinder-volume[76679]: DEBUG oslo_service.periodic_task [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] Running periodic task VolumeManager._thread_info {{(pid=76679) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:38:36 devstack cinder-volume[76679]: DEBUG cinder.volume.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] thread count: 6 {{(pid=76679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:38:36 devstack cinder-volume[76679]: DEBUG cinder.volume.manager [None req-4b8e1aeb-3d1a-4bae-94b6-d97f4f9d0831 None None] thread info: [<_MainThread(MainThread, started 133066386571392)>, , , , , ] {{(pid=76679) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:39:16 devstack cinder-volume[76679]: DEBUG dbcounter [-] [76679] Writing DB stats cinder:SELECT=1 {{(pid=76679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:39:16 devstack cinder-volume[76679]: DEBUG dbcounter [-] [76679] Writing DB stats cinder:UPDATE=1 {{(pid=76679) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:39:27 devstack cinder-volume[76513]: INFO oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Caught SIGTERM, stopping children Sep 07 16:39:27 devstack cinder-volume[76513]: DEBUG oslo_concurrency.lockutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Acquiring lock "singleton_lock" {{(pid=76513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:39:27 devstack cinder-volume[76513]: DEBUG oslo_concurrency.lockutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Acquired lock "singleton_lock" {{(pid=76513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:39:27 devstack cinder-volume[76513]: DEBUG oslo_concurrency.lockutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Releasing lock "singleton_lock" {{(pid=76513) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:39:27 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Stop services. {{(pid=76513) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 16:39:27 devstack cinder-volume[76513]: DEBUG oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Killing children. {{(pid=76513) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 16:39:27 devstack cinder-volume[76513]: INFO oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Waiting on 1 children to exit Sep 07 16:39:30 devstack cinder-volume[76679]: DEBUG oslo_concurrency.lockutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Acquiring lock "singleton_lock" {{(pid=76679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:39:30 devstack cinder-volume[76679]: DEBUG oslo_concurrency.lockutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Acquired lock "singleton_lock" {{(pid=76679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:39:30 devstack cinder-volume[76679]: DEBUG oslo_concurrency.lockutils [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Releasing lock "singleton_lock" {{(pid=76679) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:39:30 devstack cinder-volume[76679]: WARNING amqp [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:39:30 devstack cinder-volume[76679]: WARNING amqp [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:39:30 devstack cinder-volume[76513]: INFO oslo_service.backend._eventlet.service [None req-96b607b7-87ce-40e5-b5d4-80c08c57e7cd None None] Child 76679 exited with status 0 Sep 07 16:39:30 devstack cinder-volume[86680]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 16:39:30 devstack cinder-volume[86680]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:39:30 devstack cinder-volume[86680]: we strongly recommend against using it for new projects. Sep 07 16:39:30 devstack cinder-volume[86680]: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:39:30 devstack cinder-volume[86680]: framework. For more detail see Sep 07 16:39:30 devstack cinder-volume[86680]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:39:30 devstack cinder-volume[86680]: import eventlet # noqa Sep 07 16:39:32 devstack cinder-volume[86680]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:39:32 devstack cinder-volume[86680]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:39:32 devstack cinder-volume[86680]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:39:33 devstack cinder-volume[86680]: INFO dbcounter [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Registered counter for database cinder Sep 07 16:39:33 devstack cinder-volume[86680]: DEBUG oslo_db.sqlalchemy.engines [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86680) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:33 devstack cinder-volume[86680]: DEBUG dbcounter [-] [86680] Writer thread running {{(pid=86680) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:39:33 devstack cinder-volume[86680]: INFO cinder.rpc [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 16:39:33 devstack cinder-volume[86680]: INFO cinder.rpc [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 16:39:33 devstack cinder-volume[86680]: DEBUG oslo_db.sqlalchemy.engines [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86680) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:34 devstack cinder-volume[86680]: INFO cinder.volume.manager [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Determined volume DB was empty at startup. Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG cinder.volume.manager [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86680) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 16:39:34 devstack cinder-volume[86680]: INFO cinder.volume.manager [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 16:39:34 devstack cinder-volume[86680]: WARNING stevedore.named [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:39:34 devstack cinder-volume[86680]: WARNING castellan.key_manager [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:39:34 devstack cinder-volume[86680]: WARNING cinder.keymgr.conf_key_mgr [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:39:34 devstack cinder-volume[86680]: INFO cinder.volume.manager [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_db.sqlalchemy.engines [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86680) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:34 devstack cinder-volume[86680]: INFO oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Starting 1 workers Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Started child 86895 {{(pid=86680) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Full set of CONF: {{(pid=86680) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] ******************************************************************************** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Configuration options gathered from: {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] ================================================================================ {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] allow_availability_zone_fallback = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] allow_compression_on_image_upload = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] allowed_direct_url_schemes = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] api_rate_limit = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] auth_strategy = keystone {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_availability_zone = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_host = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_stats_polling_interval = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backup_api_class = cinder.backup.api.API {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backup_name_template = backup-%s {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86895]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backup_use_same_host = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backup_use_temp_snapshot = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] chap_password = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] chap_username = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_internal_tenant_project_id = bdccaf91f96c42ec969405de90280667 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_internal_tenant_user_id = a59ebaea5fd041d4bdf7dba7da667dec {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cluster = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] compression_format = gzip {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] compute_api_class = cinder.compute.nova.API {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] config_dir = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] config_source = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] control_exchange = openstack {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] debug = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] default_availability_zone = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] default_group_type = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] default_volume_type = QuobyteHD {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] disk_geometry = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] driver_client_cert = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] driver_client_cert_key = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] driver_data_namespace = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] driver_ssl_cert_path = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] driver_ssl_cert_verify = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] driver_use_ssl = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] enable_new_services = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] enable_unsupported_driver = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] enabled_backends = ['QuobyteHD'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] enforce_multipath_for_image_xfer = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] filter_function = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_api_insecure = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_api_ssl_compression = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_ca_certificates_file = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_catalog_info = image:glance:publicURL {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_num_retries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance_request_timeout = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] goodness_function = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] graceful_shutdown_timeout = 5 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] group_api_class = cinder.group.api.API {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] host = devstack {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_compress_on_upload = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_conversion_address_space_limit = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_conversion_cpu_limit = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_conversion_disable = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_upload_use_cinder_backend = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_upload_use_internal_tenant = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_volume_cache_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_volume_cache_max_count = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] image_volume_cache_max_size_gb = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] init_host_max_objects_retrieval = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] instance_format = [instance: %(uuid)s] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] iscsi_target_flags = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] iscsi_write_cache = on {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] iser_helper = tgtadm {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] iser_ip_address = 192.168.122.91 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] iser_port = 3260 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_color = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_config_append = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_dir = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_file = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_options = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_rotate_interval = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_rotate_interval_type = days {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] log_rotation_type = none {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] max_age = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] max_logfile_count = 30 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] max_logfile_size_mb = 200 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] max_over_subscription_ratio = 20.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] message_reap_interval = 86400 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] message_ttl = 2592000 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] migration_create_volume_timeout_secs = 300 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] monkey_patch = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] monkey_patch_modules = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] my_ip = 192.168.122.91 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] no_snapshot_gb_quota = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] num_iser_scan_tries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] num_shell_tries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] num_volume_device_scan_tries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] nvmeof_conn_info_version = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] nvmet_ns_id = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] nvmet_port_id = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] osapi_max_limit = 1000 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] osapi_volume_ext_list = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] osapi_volume_listen = 0.0.0.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] osapi_volume_listen_port = 8776 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] osapi_volume_use_ssl = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] osapi_volume_workers = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] per_volume_size_limit = -1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] periodic_fuzzy_delay = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] periodic_interval = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] project_id_regex = [0-9a-f\-]+ {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] public_endpoint = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] publish_errors = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] quota_backup_gigabytes = 1000 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] quota_backups = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] quota_gigabytes = 1000 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] quota_groups = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] quota_snapshots = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] quota_volumes = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] rate_limit_burst = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] rate_limit_except_level = CRITICAL {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] rate_limit_interval = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] reinit_driver_count = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] replication_device = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] report_discard_supported = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] report_interval = 120 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] reservation_clean_interval = 86400 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] reservation_expire = 86400 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] reserved_image_namespaces = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] reserved_percentage = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] rpc_response_timeout = 120 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] run_external_periodic_tasks = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] scst_target_driver = iscsi {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] scst_target_iqn_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_down_time = 720 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] shell_completion = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] snapshot_name_template = snapshot-%s {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] split_loggers = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] state_path = /opt/stack/data/cinder {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] storage_availability_zone = nova {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] storage_protocol = iSCSI {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] syslog_log_facility = LOG_USER {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] target_helper = lioadm {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] target_ip_address = 192.168.122.91 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] target_port = 3260 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] target_protocol = iscsi {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] target_secondary_ip_addresses = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] trace_flags = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] transfer_api_class = cinder.transfer.api.API {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] transport_url = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86895]: INFO cinder.volume.manager [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] until_refresh = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] use_chap_auth = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] use_default_quota_class = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] use_journal = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] use_json = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] use_multipath_for_image_xfer = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] use_stderr = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] use_syslog = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] verify_glance_signatures = enabled {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_api_class = cinder.volume.api.API {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.remotefs [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86895) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_backend_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_clear = zero {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_clear_ionice = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_clear_size = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_copy_bps_limit = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_dd_blocksize = 1M {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_name_template = volume-%s {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_service_inithost_offload = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volume_usage_audit_period = month {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] zoning_mode = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_concurrency.disable_process_locking = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.auth_section = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.auth_type = password {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.auth_version = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.cache = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.delay_auth_decision = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.http_connect_timeout = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.include_service_catalog = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.insecure = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.interface = public {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_password = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcache_username = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.region_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.service_token_roles_required = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.service_type = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.token_cache_time = 300 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.backend = dogpile.cache.null {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.backend_argument = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.backend_expiration_time = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.config_prefix = cache.oslo {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.debug_cache_backend = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.enable_retry_client = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.enable_socket_keepalive = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.expiration_time = 600 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.hashclient_retry_attempts = 2 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.memcache_dead_retry = 300 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.memcache_pool_maxsize = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.memcache_sasl_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.password = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.proxies = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.redis_db = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.redis_sentinel_service_name = mymaster {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.redis_server = localhost:6379 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.retry_attempts = 2 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.retry_delay = 0.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.socket_keepalive_count = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.socket_keepalive_idle = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.socket_keepalive_interval = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.socket_timeout = 1.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.tls_allowed_ciphers = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.tls_cafile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.tls_certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.tls_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.tls_keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cache.username = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] coordination.backend_url = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.asyncio_connection = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.asyncio_slave_connection = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.backend = sqlalchemy {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.connection = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.connection_debug = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.connection_parameters = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.connection_recycle_time = 3600 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.connection_trace = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.db_inc_retry_interval = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.db_max_retries = 20 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.db_max_retry_interval = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.db_retry_interval = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.max_overflow = 50 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.max_pool_size = 5 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.max_retries = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.mysql_wsrep_sync_wait = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.pool_timeout = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.retry_interval = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.slave_connection = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.sqlite_synchronous = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.synchronous_reader = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] database.use_db_reconnect = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_tracing.insecure = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.connection_string = messaging:// {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.es_doc_type = notification {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.es_scroll_size = 10000 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.es_scroll_time = 2m {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.filter_error_trace = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.hmac_keys = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.sentinel_service_name = mymaster {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.socket_timeout = 0.1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.trace_requests = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler.trace_sqlalchemy = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler_jaeger.process_tags = {} {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler_jaeger.service_name_prefix = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] profiler_otlp.service_name_prefix = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.enforce_new_defaults = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.policy_default_rule = default {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.policy_file = policy.yaml {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_policy.remote_timeout = 60.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] privsep_osbrick.group = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] privsep_osbrick.helper_command = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] privsep_osbrick.user = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_sys_admin.group = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_sys_admin.helper_command = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] cinder_sys_admin.user = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.auth_section = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.auth_type = password {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.cafile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.collect_timing = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.insecure = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.send_service_user_token = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.split_loggers = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.timeout = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.tls_ciphers = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] service_user.tls_min_version = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.auth_section = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.auth_type = password {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.collect_timing = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.insecure = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.region_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.split_loggers = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.timeout = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.tls_ciphers = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] glance.tls_min_version = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.backend_availability_zone = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.chap_password = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.chap_username = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.disk_geometry = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.driver_client_cert = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.driver_client_cert_key = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.driver_data_namespace = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.driver_use_ssl = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.enable_unsupported_driver = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.extra_capabilities = {} {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.filter_function = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.goodness_function = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.iscsi_target_flags = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.iscsi_write_cache = on {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.iser_helper = tgtadm {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.iser_port = 3260 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_host = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_login = admin {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_mount_options = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_password = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_private_key = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_share_path = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_ssh_port = 22 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.num_shell_tries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.nvmet_port_id = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.quobyte_client_cfg = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.quobyte_volume_url = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.replication_device = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.report_discard_supported = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.reserved_percentage = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.scst_target_driver = iscsi {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.scst_target_iqn_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.storage_protocol = iSCSI {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.target_helper = tgtadm {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.target_port = 3260 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.target_protocol = iscsi {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.trace_flags = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.unique_fqdn_network = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.use_chap_auth = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_backend_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_clear = zero {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_clear_ionice = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_clear_size = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_reports.file_event_handler = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_reports.log_dir = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.backend_availability_zone = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.backend_host = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.chap_password = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.chap_username = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.chiscsi_conf = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.disk_geometry = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.driver_client_cert = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.driver_client_cert_key = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.driver_data_namespace = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86895) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.driver_use_ssl = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.extra_capabilities = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.filter_function = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.goodness_function = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86895]: WARNING cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.iscsi_target_flags = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.iscsi_write_cache = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.iser_helper = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86895]: WARNING cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.iser_ip_address = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.iser_port = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.iser_target_prefix = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Running cmd (subprocess): mount.quobyte {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_host = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_login = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_mount_options = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_password = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_private_key = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_share_path = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_ssh_port = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.num_shell_tries = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nvmet_ns_id = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.nvmet_port_id = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.replication_device = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.report_discard_supported = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.reserved_percentage = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.scst_target_driver = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.storage_protocol = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.target_helper = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.target_ip_address = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.target_port = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.target_prefix = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.target_protocol = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.trace_flags = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.unique_fqdn_network = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.use_chap_auth = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_clear = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_clear_ionice = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_clear_size = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] QuobyteHD.volumes_dir = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.ssl = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.ssl_version = {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_notifications.driver = [] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_notifications.retry = -1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] oslo_messaging_notifications.transport_url = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] key_manager.fixed_key = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.barbican_api_version = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.barbican_endpoint = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.barbican_endpoint_type = public {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.barbican_region_name = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.cafile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.collect_timing = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.insecure = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.number_of_retries = 60 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.retry_delay = 1 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.send_service_user_token = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.split_loggers = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.timeout = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.tls_ciphers = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.tls_min_version = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.verify_ssl = True {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican.verify_ssl_path = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.auth_section = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.auth_type = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.cafile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.certfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.collect_timing = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.insecure = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.keyfile = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.split_loggers = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.timeout = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.tls_ciphers = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] barbican_service_user.tls_min_version = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.approle_role_id = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.approle_secret_id = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.auth_method = approle {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.auth_path = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.kv_mountpoint = secret {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.kv_path = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.kv_version = 2 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.namespace = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.root_token_id = **** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.ssl_ca_crt_file = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.timeout = 60.0 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.token_file = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.token_role = None {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.use_ssl = False {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:34 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] ******************************************************************************** {{(pid=86680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=86895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:39:34 devstack cinder-volume[86895]: INFO cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d ... Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 -c /etc/quobyte/client-cinder.cfg {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:34 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 -c /etc/quobyte/client-cinder.cfg Sep 07 16:39:34 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:34 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.416s {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:34 devstack cinder-volume[86895]: INFO cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d succeeded Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=86895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.427s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:39:34 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:35 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:39:35 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:35 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.246s {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:35 devstack cinder-volume[86895]: INFO cinder.volume.driver [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Driver hasn't implemented _init_vendor_properties() Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.volume.driver [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.566562652588, 'free_capacity_gb': 1773.566562652588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86895) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_db.sqlalchemy.engines [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG dbcounter [-] [86895] Writer thread running {{(pid=86895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.db.api [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Building query based on filter {{(pid=86895) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.image.image_utils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86895) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 16:39:35 devstack cinder-volume[86895]: INFO cinder.keymgr.migration [None req-1db02e51-d5b5-4646-ac4a-f5ef355269a1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=86895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=86895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:35 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:39:35 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:35 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.245s {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.manager [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Notifying Schedulers of capabilities ... {{(pid=86895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:39:35 devstack cinder-volume[86895]: INFO cinder.volume.manager [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Driver initialization completed successfully. Sep 07 16:39:35 devstack cinder-volume[86895]: INFO cinder.manager [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Initiating service 3 cleanup Sep 07 16:39:35 devstack cinder-volume[86895]: INFO cinder.manager [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Service 3 cleanup completed. Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.service [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Creating RPC server for service cinder-volume {{(pid=86895) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.service [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86895) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 16:39:35 devstack cinder-volume[86895]: INFO cinder.volume.manager [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=86895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=86895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:39:35 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:35 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:39:35 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:36 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:36 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.259s {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:36 devstack cinder-volume[86895]: INFO cinder.volume.manager [None req-4266a009-90b8-4fb0-afc1-77899f49b7ba None None] Driver post RPC initialization completed successfully. Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=86895) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG cinder.volume.drivers.quobyte [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=86895) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86895) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:40 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:39:40 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:40 devstack cinder-volume[86680]: INFO oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Caught SIGTERM, stopping children Sep 07 16:39:40 devstack cinder-volume[86680]: DEBUG oslo_concurrency.lockutils [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Acquiring lock "singleton_lock" {{(pid=86680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:39:40 devstack cinder-volume[86680]: DEBUG oslo_concurrency.lockutils [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Acquired lock "singleton_lock" {{(pid=86680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:39:40 devstack cinder-volume[86680]: DEBUG oslo_concurrency.lockutils [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Releasing lock "singleton_lock" {{(pid=86680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:39:40 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Stop services. {{(pid=86680) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 16:39:40 devstack cinder-volume[86680]: DEBUG oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Killing children. {{(pid=86680) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 16:39:40 devstack cinder-volume[86680]: INFO oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Waiting on 1 children to exit Sep 07 16:39:40 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG oslo_concurrency.processutils [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.251s {{(pid=86895) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:40 devstack cinder-volume[86895]: DEBUG cinder.manager [None req-9adb9c04-06b2-4efe-b300-0e456ec1b36f None None] Notifying Schedulers of capabilities ... {{(pid=86895) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:39:44 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Acquiring lock "singleton_lock" {{(pid=86895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:39:44 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Acquired lock "singleton_lock" {{(pid=86895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:39:44 devstack cinder-volume[86895]: DEBUG oslo_concurrency.lockutils [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Releasing lock "singleton_lock" {{(pid=86895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:39:44 devstack cinder-volume[86895]: WARNING amqp [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:39:44 devstack cinder-volume[86895]: WARNING amqp [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:39:44 devstack cinder-volume[86680]: INFO oslo_service.backend._eventlet.service [None req-256053eb-b0a1-4dd4-b34e-44d4c22705be None None] Child 86895 exited with status 0 Sep 07 16:39:44 devstack cinder-volume[87183]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 16:39:44 devstack cinder-volume[87183]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:39:44 devstack cinder-volume[87183]: we strongly recommend against using it for new projects. Sep 07 16:39:44 devstack cinder-volume[87183]: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:39:44 devstack cinder-volume[87183]: framework. For more detail see Sep 07 16:39:44 devstack cinder-volume[87183]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:39:44 devstack cinder-volume[87183]: import eventlet # noqa Sep 07 16:39:47 devstack cinder-volume[87183]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:39:47 devstack cinder-volume[87183]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:39:47 devstack cinder-volume[87183]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87183) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:39:48 devstack cinder-volume[87183]: INFO dbcounter [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Registered counter for database cinder Sep 07 16:39:48 devstack cinder-volume[87183]: DEBUG oslo_db.sqlalchemy.engines [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87183) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:48 devstack cinder-volume[87183]: DEBUG dbcounter [-] [87183] Writer thread running {{(pid=87183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:39:48 devstack cinder-volume[87183]: INFO cinder.rpc [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 16:39:48 devstack cinder-volume[87183]: INFO cinder.rpc [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 16:39:48 devstack cinder-volume[87183]: DEBUG oslo_db.sqlalchemy.engines [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87183) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:49 devstack cinder-volume[87183]: INFO cinder.volume.manager [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Determined volume DB was empty at startup. Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG cinder.volume.manager [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87183) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 16:39:49 devstack cinder-volume[87183]: WARNING stevedore.named [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:39:49 devstack cinder-volume[87183]: WARNING castellan.key_manager [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:39:49 devstack cinder-volume[87183]: WARNING cinder.keymgr.conf_key_mgr [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:39:49 devstack cinder-volume[87183]: INFO cinder.volume.manager [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_db.sqlalchemy.engines [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87183) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:49 devstack cinder-volume[87183]: INFO oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Starting 1 workers Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Started child 87492 {{(pid=87183) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Full set of CONF: {{(pid=87183) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] ******************************************************************************** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] Configuration options gathered from: {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] ================================================================================ {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] allow_availability_zone_fallback = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] allow_compression_on_image_upload = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87492]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] allowed_direct_url_schemes = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] api_rate_limit = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] auth_strategy = keystone {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_availability_zone = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_host = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_stats_polling_interval = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backup_api_class = cinder.backup.api.API {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backup_name_template = backup-%s {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backup_use_same_host = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backup_use_temp_snapshot = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] chap_password = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] chap_username = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_internal_tenant_project_id = bdccaf91f96c42ec969405de90280667 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_internal_tenant_user_id = a59ebaea5fd041d4bdf7dba7da667dec {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cluster = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] compression_format = gzip {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] compute_api_class = cinder.compute.nova.API {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] config_dir = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] config_source = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] control_exchange = openstack {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] debug = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] default_availability_zone = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] default_group_type = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] default_volume_type = QuobyteHD {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] disk_geometry = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] driver_client_cert = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] driver_client_cert_key = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] driver_data_namespace = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] driver_ssl_cert_path = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] driver_ssl_cert_verify = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] driver_use_ssl = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] enable_new_services = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] enable_unsupported_driver = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] enabled_backends = ['QuobyteHD'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] enforce_multipath_for_image_xfer = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] filter_function = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_api_insecure = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_api_servers = ['http://192.168.122.91/image'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_api_ssl_compression = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_ca_certificates_file = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_catalog_info = image:glance:publicURL {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_num_retries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance_request_timeout = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] goodness_function = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] graceful_shutdown_timeout = 5 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] group_api_class = cinder.group.api.API {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] host = devstack {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_compress_on_upload = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_conversion_address_space_limit = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_conversion_cpu_limit = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_conversion_disable = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_upload_use_cinder_backend = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_upload_use_internal_tenant = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_volume_cache_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_volume_cache_max_count = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] image_volume_cache_max_size_gb = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] init_host_max_objects_retrieval = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] instance_format = [instance: %(uuid)s] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] iscsi_target_flags = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] iscsi_write_cache = on {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] iser_helper = tgtadm {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] iser_ip_address = 192.168.122.91 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] iser_port = 3260 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_color = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_config_append = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_dir = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_file = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_options = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_rotate_interval = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_rotate_interval_type = days {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] log_rotation_type = none {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87492) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] max_age = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] max_logfile_count = 30 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] max_logfile_size_mb = 200 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] max_over_subscription_ratio = 20.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] message_reap_interval = 86400 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] message_ttl = 2592000 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] migration_create_volume_timeout_secs = 300 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] monkey_patch = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] monkey_patch_modules = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] my_ip = 192.168.122.91 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] no_snapshot_gb_quota = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] num_iser_scan_tries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] num_shell_tries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] num_volume_device_scan_tries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] nvmeof_conn_info_version = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] nvmet_ns_id = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] nvmet_port_id = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] osapi_max_limit = 1000 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] osapi_volume_ext_list = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] osapi_volume_listen = 0.0.0.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] osapi_volume_listen_port = 8776 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] osapi_volume_use_ssl = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] osapi_volume_workers = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] per_volume_size_limit = -1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] periodic_fuzzy_delay = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] periodic_interval = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] project_id_regex = [0-9a-f\-]+ {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] public_endpoint = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] publish_errors = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] quota_backup_gigabytes = 1000 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] quota_backups = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] quota_gigabytes = 1000 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] quota_groups = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] quota_snapshots = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] quota_volumes = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] rate_limit_burst = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] rate_limit_except_level = CRITICAL {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] rate_limit_interval = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] reinit_driver_count = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] replication_device = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] report_discard_supported = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] report_interval = 120 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] reservation_clean_interval = 86400 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] reservation_expire = 86400 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] reserved_image_namespaces = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] reserved_percentage = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] rpc_response_timeout = 120 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] run_external_periodic_tasks = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] scst_target_driver = iscsi {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] scst_target_iqn_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_down_time = 720 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] shell_completion = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] snapshot_name_template = snapshot-%s {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] split_loggers = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] state_path = /opt/stack/data/cinder {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] storage_availability_zone = nova {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] storage_protocol = iSCSI {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] syslog_log_facility = LOG_USER {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] target_helper = lioadm {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] target_ip_address = 192.168.122.91 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] target_port = 3260 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] target_protocol = iscsi {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] target_secondary_ip_addresses = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] trace_flags = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] transfer_api_class = cinder.transfer.api.API {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] transport_url = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] until_refresh = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] use_chap_auth = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] use_default_quota_class = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] use_journal = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] use_json = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] use_multipath_for_image_xfer = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] use_stderr = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] use_syslog = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] verify_glance_signatures = enabled {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_api_class = cinder.volume.api.API {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_backend_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_clear = zero {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_clear_ionice = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_clear_size = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_copy_bps_limit = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_dd_blocksize = 1M {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_name_template = volume-%s {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_service_inithost_offload = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volume_usage_audit_period = month {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] zoning_mode = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_concurrency.disable_process_locking = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.auth_section = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.auth_type = password {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.auth_version = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.cache = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.delay_auth_decision = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.http_connect_timeout = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.include_service_catalog = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.insecure = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.interface = public {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_password = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcache_username = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.region_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.service_token_roles_required = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.service_type = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.token_cache_time = 300 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.91/identity {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.backend = dogpile.cache.null {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.backend_argument = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.backend_expiration_time = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.config_prefix = cache.oslo {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.debug_cache_backend = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.enable_retry_client = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87492) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.enable_socket_keepalive = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.expiration_time = 600 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.hashclient_retry_attempts = 2 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.memcache_dead_retry = 300 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Running cmd (subprocess): mount.quobyte {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.memcache_pool_maxsize = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.memcache_sasl_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.password = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.proxies = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.redis_db = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.redis_sentinel_service_name = mymaster {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.redis_server = localhost:6379 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.retry_attempts = 2 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.retry_delay = 0.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.socket_keepalive_count = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.socket_keepalive_idle = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.socket_keepalive_interval = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.socket_timeout = 1.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.tls_allowed_ciphers = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.tls_cafile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.tls_certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.tls_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.tls_keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cache.username = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] coordination.backend_url = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.asyncio_connection = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.asyncio_slave_connection = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.backend = sqlalchemy {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.connection = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.connection_debug = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.connection_parameters = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.connection_recycle_time = 3600 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.connection_trace = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.db_inc_retry_interval = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.db_max_retries = 20 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.db_max_retry_interval = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.db_retry_interval = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.max_overflow = 50 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.max_pool_size = 5 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.max_retries = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.mysql_wsrep_sync_wait = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.pool_timeout = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.retry_interval = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.slave_connection = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.sqlite_synchronous = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.synchronous_reader = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] database.use_db_reconnect = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_tracing.insecure = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.connection_string = messaging:// {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.es_doc_type = notification {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.es_scroll_size = 10000 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.es_scroll_time = 2m {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.filter_error_trace = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.hmac_keys = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.sentinel_service_name = mymaster {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.socket_timeout = 0.1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.trace_requests = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler.trace_sqlalchemy = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler_jaeger.process_tags = {} {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler_jaeger.service_name_prefix = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] profiler_otlp.service_name_prefix = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.enforce_new_defaults = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.policy_default_rule = default {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.policy_file = policy.yaml {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_policy.remote_timeout = 60.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] privsep_osbrick.group = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] privsep_osbrick.helper_command = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] privsep_osbrick.user = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_sys_admin.group = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_sys_admin.helper_command = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] cinder_sys_admin.user = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.auth_section = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.auth_type = password {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.cafile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.collect_timing = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.insecure = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.send_service_user_token = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.split_loggers = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.timeout = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.tls_ciphers = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] service_user.tls_min_version = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.auth_section = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.auth_type = password {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.collect_timing = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.insecure = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.region_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.split_loggers = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.timeout = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.tls_ciphers = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] glance.tls_min_version = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.backend_availability_zone = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.chap_password = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.chap_username = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.disk_geometry = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.driver_client_cert = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.driver_client_cert_key = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.driver_data_namespace = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.driver_use_ssl = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.enable_unsupported_driver = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.extra_capabilities = {} {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.filter_function = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.goodness_function = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.iscsi_target_flags = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.iscsi_write_cache = on {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.iser_helper = tgtadm {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.iser_ip_address = 192.168.122.91 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.iser_port = 3260 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_host = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_login = admin {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_mount_options = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_password = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_private_key = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_share_path = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_ssh_port = 22 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.num_shell_tries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.nvmet_port_id = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.quobyte_client_cfg = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.quobyte_volume_url = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.replication_device = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.report_discard_supported = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.reserved_percentage = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.scst_target_driver = iscsi {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.scst_target_iqn_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.storage_protocol = iSCSI {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.target_helper = tgtadm {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.target_ip_address = 192.168.122.91 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.target_port = 3260 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack quobyte-client[87493]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.target_protocol = iscsi {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.trace_flags = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.unique_fqdn_network = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack quobyte-client[87493]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.use_chap_auth = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_backend_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_clear = zero {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_clear_ionice = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_clear_size = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_reports.file_event_handler = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_reports.log_dir = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.backend_availability_zone = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.backend_host = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.chap_password = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] CMD "mount.quobyte" returned: 1 in 0.078s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.chap_username = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.chiscsi_conf = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.disk_geometry = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.driver_client_cert = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.driver_client_cert_key = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.driver_data_namespace = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.driver_use_ssl = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.extra_capabilities = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.filter_function = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.goodness_function = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.iscsi_target_flags = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.iscsi_write_cache = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.iser_helper = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.iser_ip_address = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.iser_port = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.iser_target_prefix = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_host = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_login = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_mount_options = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_password = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_private_key = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_share_path = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_ssh_port = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.num_shell_tries = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nvmet_ns_id = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.nvmet_port_id = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.replication_device = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.report_discard_supported = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.reserved_percentage = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.scst_target_driver = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.storage_protocol = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.target_helper = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.target_ip_address = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.target_port = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.target_prefix = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.target_protocol = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.trace_flags = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.unique_fqdn_network = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.use_chap_auth = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_clear = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_clear_ionice = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_clear_size = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] QuobyteHD.volumes_dir = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.ssl = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.ssl_version = {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_notifications.driver = [] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_notifications.retry = -1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] oslo_messaging_notifications.transport_url = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] key_manager.fixed_key = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.barbican_api_version = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.barbican_endpoint = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.barbican_endpoint_type = public {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.barbican_region_name = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.cafile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.collect_timing = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.insecure = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.number_of_retries = 60 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.retry_delay = 1 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.send_service_user_token = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.split_loggers = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.timeout = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.tls_ciphers = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.tls_min_version = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.verify_ssl = True {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican.verify_ssl_path = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.auth_section = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.auth_type = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.cafile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.certfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.collect_timing = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.insecure = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.keyfile = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.split_loggers = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.timeout = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.tls_ciphers = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] barbican_service_user.tls_min_version = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.approle_role_id = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.approle_secret_id = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.auth_method = approle {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.auth_path = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.kv_mountpoint = secret {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.kv_path = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.kv_version = 2 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.namespace = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.root_token_id = **** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.ssl_ca_crt_file = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.timeout = 60.0 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.token_file = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.token_role = None {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.use_ssl = False {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:39:49 devstack cinder-volume[87183]: DEBUG oslo_service.backend._eventlet.service [None req-c5d672a6-4eea-4fb9-8a54-abc240d4b1ca None None] ******************************************************************************** {{(pid=87183) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 16:39:49 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.259s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:49 devstack cinder-volume[87492]: INFO cinder.volume.driver [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Driver hasn't implemented _init_vendor_properties() Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.volume.driver [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.566562652588, 'free_capacity_gb': 1773.566562652588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87492) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_db.sqlalchemy.engines [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87492) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writer thread running {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.db.api [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Building query based on filter {{(pid=87492) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87492) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:49 devstack cinder-volume[87492]: INFO cinder.keymgr.migration [None req-e2120d49-086c-4640-895e-159dfa03bd18 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 16:39:49 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:39:49 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:49 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:49 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:39:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Driver initialization completed successfully. Sep 07 16:39:50 devstack cinder-volume[87492]: INFO cinder.manager [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Initiating service 3 cleanup Sep 07 16:39:50 devstack cinder-volume[87492]: INFO cinder.manager [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Service 3 cleanup completed. Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG cinder.service [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Creating RPC server for service cinder-volume {{(pid=87492) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG cinder.service [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87492) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 16:39:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:39:50 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:39:50 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:39:50 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Sep 07 16:39:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.235s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:39:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-548a1cc6-d641-4259-bb1f-673df9859e2f None None] Driver post RPC initialization completed successfully. Sep 07 16:39:59 devstack cinder-volume[87183]: DEBUG dbcounter [-] [87183] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87183) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:40:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:40:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:40:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:40:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 6 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:40:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Flow 'volume_create_manager' (e811beed-13e8-4b98-9767-98789b7833ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3b797c-31ff-4739-bf98-94766cf7141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3b797c-31ff-4739-bf98-94766cf7141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-24667024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ddea4c-cf7f-42de-b0f3-7098a1454d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13e6323244f4288b55af0cb6016be37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:41:19Z,use_quota=True,user_id='2f2e87d928894d1797dd09f95699f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a008b3-8d51-45da-9bd2-43f26c0f58b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a008b3-8d51-45da-9bd2-43f26c0f58b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe2a140-4a5e-411d-818c-17f6e4ee4c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe2a140-4a5e-411d-818c-17f6e4ee4c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ddea4c-cf7f-42de-b0f3-7098a1454d05', 'volume_name': 'volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79add7ac-f6df-463b-b948-7d867176fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79add7ac-f6df-463b-b948-7d867176fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a89872-1b32-450d-9612-e414131477f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:19 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Volume 46ddea4c-cf7f-42de-b0f3-7098a1454d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05', 'volume_size': 1} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-24667024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ddea4c-cf7f-42de-b0f3-7098a1454d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f13e6323244f4288b55af0cb6016be37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:41:19Z,use_quota=True,user_id='2f2e87d928894d1797dd09f95699f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Creating volume 46ddea4c-cf7f-42de-b0f3-7098a1454d05 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:41:20 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:41:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:20 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 1073741824 Sep 07 16:41:20 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:21 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 1073741824" returned: 0 in 1.747s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:21 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 Sep 07 16:41:21 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:22 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05" returned: 0 in 0.608s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:41:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.538s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a89872-1b32-450d-9612-e414131477f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a243ab-0c3d-4666-8d72-7c6205b26946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:22 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Volume volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 (46ddea4c-cf7f-42de-b0f3-7098a1454d05): created successfully Sep 07 16:41:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a243ab-0c3d-4666-8d72-7c6205b26946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Flow 'volume_create_manager' (e811beed-13e8-4b98-9767-98789b7833ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:41:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b2c23008-2e11-4e9a-b5ad-db4d67672482 tempest-ServerRescueNegativeTestJSON-1870165946 None] Created volume successfully. Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Flow 'volume_create_manager' (cf3cec69-554b-4e56-b800-735dd073f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee536f1-7285-4dca-a08d-5debdfa54410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee536f1-7285-4dca-a08d-5debdfa54410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-441162387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f20e14-eb09-414f-93cf-e4797c88f857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080ef7da0eb744618b14df253dfa1e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:41:24Z,use_quota=True,user_id='1ff9da8a179944328d9cfbf629dfee4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f925440c-fce3-4665-8ae2-1979c24d3640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f925440c-fce3-4665-8ae2-1979c24d3640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e00c5e-737e-47a3-8482-1eaf2c62ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e00c5e-737e-47a3-8482-1eaf2c62ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f20e14-eb09-414f-93cf-e4797c88f857', 'volume_name': 'volume-43f20e14-eb09-414f-93cf-e4797c88f857', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86a6072-10b8-4941-8a59-d3d5f79c3592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86a6072-10b8-4941-8a59-d3d5f79c3592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2f5a7a-1a0a-49ca-9813-b036583ee8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:24 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Volume 43f20e14-eb09-414f-93cf-e4797c88f857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f20e14-eb09-414f-93cf-e4797c88f857', 'volume_size': 1} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-441162387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f20e14-eb09-414f-93cf-e4797c88f857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080ef7da0eb744618b14df253dfa1e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:41:24Z,use_quota=True,user_id='1ff9da8a179944328d9cfbf629dfee4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Creating volume 43f20e14-eb09-414f-93cf-e4797c88f857 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:41:24 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:41:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:24 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 1073741824 Sep 07 16:41:24 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:25 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 1073741824" returned: 0 in 0.913s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:25 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 Sep 07 16:41:25 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:26 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857" returned: 0 in 0.561s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:41:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2f5a7a-1a0a-49ca-9813-b036583ee8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f20e14-eb09-414f-93cf-e4797c88f857', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd76f93-edbc-41a6-8ff8-fed7ee961973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Volume volume-43f20e14-eb09-414f-93cf-e4797c88f857 (43f20e14-eb09-414f-93cf-e4797c88f857): created successfully Sep 07 16:41:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd76f93-edbc-41a6-8ff8-fed7ee961973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Flow 'volume_create_manager' (cf3cec69-554b-4e56-b800-735dd073f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:41:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f6bb7f28-e652-4442-9470-5d647a951044 tempest-VolumesAdminNegativeTest-852900895 None] Created volume successfully. Sep 07 16:41:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Acquiring lock "cinder-43f20e14-eb09-414f-93cf-e4797c88f857-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:41:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Lock "cinder-43f20e14-eb09-414f-93cf-e4797c88f857-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:41:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Acquiring lock "cinder-quobyte-43f20e14-eb09-414f-93cf-e4797c88f857" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:41:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Lock "cinder-quobyte-43f20e14-eb09-414f-93cf-e4797c88f857" acquired by "delete_volume" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:41:27 devstack cinder-volume[87492]: INFO oslo.privsep.daemon [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpot8nkcz9/privsep.sock'] Sep 07 16:41:27 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpot8nkcz9/privsep.sock Sep 07 16:41:27 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 16:41:29 devstack cinder-volume[87492]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 16:41:30 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:30 devstack cinder-volume[87492]: INFO oslo.privsep.daemon [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Spawned new privsep daemon via rootwrap Sep 07 16:41:30 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Accepted privsep connection to /tmp/tmpot8nkcz9/privsep.sock {{(pid=87492) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 16:41:30 devstack cinder-volume[87492]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 16:41:30 devstack cinder-volume[87492]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 16:41:30 devstack cinder-volume[87492]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 16:41:30 devstack cinder-volume[87492]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88861 Sep 07 16:41:30 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db25a75-f754-4bfb-8eaa-6de13a769223]: (2,) {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:41:30 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03f5c10-fdb3-4b1f-b074-a0c2575fce7e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:41:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:30 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 Sep 07 16:41:30 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:31 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857" returned: 0 in 1.195s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:31 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857 Sep 07 16:41:31 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:32 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-43f20e14-eb09-414f-93cf-e4797c88f857" returned: 0 in 0.798s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Lock "cinder-quobyte-43f20e14-eb09-414f-93cf-e4797c88f857" released by "delete_volume" :: held 4.677s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:41:32 devstack cinder-volume[87492]: WARNING cinder.quota [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:41:32 devstack cinder-volume[87492]: WARNING cinder.quota [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Created reservations ['b67ed8d3-77ce-4582-a7ac-58bfcbb6c527', '79453d7f-1679-43d4-8d04-655ee9df95a7', '89e6c4ab-09d9-4173-89dc-b212e00577d2', 'b52085e6-0735-49cf-89ea-b3fbf3378867'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:32 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:41:32 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:33 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.506s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:41:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Deleted volume successfully. Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b4ae7ac1-6ce0-49b0-8add-0068dcf5dcb4 tempest-VolumesAdminNegativeTest-852900895 None] Lock "cinder-43f20e14-eb09-414f-93cf-e4797c88f857-delete_volume" released by "delete_volume" :: held 5.946s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:33 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:41:33 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:34 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.681s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:34 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:41:34 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:41:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 8 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:41:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Flow 'volume_create_manager' (86d224a7-2e75-461e-9210-78ea831cb8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0d55c4-b2b8-48f6-9f20-179ee70b39a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf0d55c4-b2b8-48f6-9f20-179ee70b39a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1714113205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347a739a-95f3-4901-8e14-ae3a31cbb30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4bb2e0414143c5a24286ad741937c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:41:36Z,use_quota=True,user_id='a88d578181874351b62f0314e7269315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69680538-69a2-4c9f-a1eb-5e0e89b21d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69680538-69a2-4c9f-a1eb-5e0e89b21d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031f3f31-bb7c-45fe-8f5b-a20e7bfaf7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031f3f31-bb7c-45fe-8f5b-a20e7bfaf7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '347a739a-95f3-4901-8e14-ae3a31cbb30b', 'volume_name': 'volume-347a739a-95f3-4901-8e14-ae3a31cbb30b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7099040e-67a9-4cd8-851d-c80cd4341cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7099040e-67a9-4cd8-851d-c80cd4341cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4487e0-99d5-4b4d-90b6-0d7ee14e17ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:36 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Volume 347a739a-95f3-4901-8e14-ae3a31cbb30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-347a739a-95f3-4901-8e14-ae3a31cbb30b', 'volume_size': 1} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1714113205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347a739a-95f3-4901-8e14-ae3a31cbb30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4bb2e0414143c5a24286ad741937c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:41:36Z,use_quota=True,user_id='a88d578181874351b62f0314e7269315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Creating volume 347a739a-95f3-4901-8e14-ae3a31cbb30b {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:41:36 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:41:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:36 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b 1073741824 Sep 07 16:41:36 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Acquiring lock "cinder-46ddea4c-cf7f-42de-b0f3-7098a1454d05-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "cinder-46ddea4c-cf7f-42de-b0f3-7098a1454d05-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:41:37 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b 1073741824" returned: 0 in 0.983s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Acquiring lock "cinder-quobyte-46ddea4c-cf7f-42de-b0f3-7098a1454d05" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "cinder-quobyte-46ddea4c-cf7f-42de-b0f3-7098a1454d05" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c13f33-9c85-45a9-b12b-47eed1743202]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:41:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:37 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b Sep 07 16:41:37 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:37 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 Sep 07 16:41:37 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:38 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b" returned: 0 in 0.469s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4487e0-99d5-4b4d-90b6-0d7ee14e17ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347a739a-95f3-4901-8e14-ae3a31cbb30b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5943b7-9fa4-4d78-858b-a0c5f4820fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:41:38 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Volume volume-347a739a-95f3-4901-8e14-ae3a31cbb30b (347a739a-95f3-4901-8e14-ae3a31cbb30b): created successfully Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5943b7-9fa4-4d78-858b-a0c5f4820fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:41:38 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Flow 'volume_create_manager' (86d224a7-2e75-461e-9210-78ea831cb8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05" returned: 0 in 0.545s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:38 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4b6c77c4-3dff-4f1a-abe3-7488c02ed539 tempest-ServerActionsTestOtherA-695842632 None] Created volume successfully. Sep 07 16:41:38 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05 Sep 07 16:41:38 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:38 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ddea4c-cf7f-42de-b0f3-7098a1454d05" returned: 0 in 0.431s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "cinder-quobyte-46ddea4c-cf7f-42de-b0f3-7098a1454d05" released by "delete_volume" :: held 1.054s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Created reservations ['51391fb9-2f84-4507-a4b0-cf536f993723', 'bc1faf10-e1e5-4460-857f-09858b0f4a10', 'e575f7e8-5909-47b7-8c34-dc8532650ddc', '4caceb3a-dc01-4948-8a5c-28eaf844ffd6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:41:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:41:38 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:41:38 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:41:39 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Sep 07 16:41:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.387s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:41:39 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:41:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Deleted volume successfully. Sep 07 16:41:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a7a1986e-e82e-45ae-a38f-c61b404cbd6e tempest-ServerRescueNegativeTestJSON-1870165946 None] Lock "cinder-46ddea4c-cf7f-42de-b0f3-7098a1454d05-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:41:48 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=24,cinder:INSERT=5,cinder:SELECT=12,cinder:DELETE=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:41:49 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:42:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:42:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Flow 'volume_create_manager' (94fb880a-70fa-4356-98df-5fbc5d13f99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951b4bb2-ad50-40a0-874e-dc328b18530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951b4bb2-ad50-40a0-874e-dc328b18530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1506023528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275fa88b-6011-4188-a3dc-398fa528dc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09185a7b3322496ba752980c803d1e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:14Z,use_quota=True,user_id='4b5b4ca98c034416a32df7786e8e9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b066a9-98ca-4ba2-a3db-1579f531c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b066a9-98ca-4ba2-a3db-1579f531c38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde1d1cb-e7a3-4452-be53-25965c1a4323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde1d1cb-e7a3-4452-be53-25965c1a4323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275fa88b-6011-4188-a3dc-398fa528dc53', 'volume_name': 'volume-275fa88b-6011-4188-a3dc-398fa528dc53', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e66e45-abd5-45fb-aeb3-e8893b1f1874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e66e45-abd5-45fb-aeb3-e8893b1f1874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7f50aa-849a-4f2f-98ab-ba91d52c2a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Volume 275fa88b-6011-4188-a3dc-398fa528dc53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275fa88b-6011-4188-a3dc-398fa528dc53', 'volume_size': 1} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1506023528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275fa88b-6011-4188-a3dc-398fa528dc53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09185a7b3322496ba752980c803d1e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:14Z,use_quota=True,user_id='4b5b4ca98c034416a32df7786e8e9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Creating volume 275fa88b-6011-4188-a3dc-398fa528dc53 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:42:14 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:42:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:14 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 1073741824 Sep 07 16:42:14 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:15 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 1073741824" returned: 0 in 0.704s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:15 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 Sep 07 16:42:15 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:15 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53" returned: 0 in 0.413s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7f50aa-849a-4f2f-98ab-ba91d52c2a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275fa88b-6011-4188-a3dc-398fa528dc53', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f018fd8-84db-41e3-adb1-57ccb5221d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:15 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Volume volume-275fa88b-6011-4188-a3dc-398fa528dc53 (275fa88b-6011-4188-a3dc-398fa528dc53): created successfully Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f018fd8-84db-41e3-adb1-57ccb5221d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Flow 'volume_create_manager' (94fb880a-70fa-4356-98df-5fbc5d13f99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:15 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5d8b4e61-c095-44c9-b29a-20aef472bbbb tempest-DeleteServersTestJSON-224722190 None] Created volume successfully. Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Flow 'volume_create_manager' (5509938d-0840-4ccc-81aa-b3564fed71a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948096f2-e29a-4dc1-9b71-cdcebfffbc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948096f2-e29a-4dc1-9b71-cdcebfffbc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-983105359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb11b4f4-363e-449c-b72f-e5b5f7c401d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17cffdfdf4b70b4ce54f065d35c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:16Z,use_quota=True,user_id='b9a95e6d97384a00ae080d252cba6293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9738c9bb-333e-48f0-b418-055688f05561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9738c9bb-333e-48f0-b418-055688f05561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4e5afe-abd6-42ae-bf4d-c177da6f5cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4e5afe-abd6-42ae-bf4d-c177da6f5cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb11b4f4-363e-449c-b72f-e5b5f7c401d1', 'volume_name': 'volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c7fffb-bbc0-40d7-93d3-de2af5a089b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c7fffb-bbc0-40d7-93d3-de2af5a089b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a6e2ad-58fd-4447-b56c-d515394ba359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:16 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Volume cb11b4f4-363e-449c-b72f-e5b5f7c401d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1', 'volume_size': 1} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-983105359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb11b4f4-363e-449c-b72f-e5b5f7c401d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e17cffdfdf4b70b4ce54f065d35c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:16Z,use_quota=True,user_id='b9a95e6d97384a00ae080d252cba6293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Creating volume cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:42:16 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:42:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:16 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 1073741824 Sep 07 16:42:16 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:17 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 1073741824" returned: 0 in 0.660s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:17 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 Sep 07 16:42:17 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:17 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" returned: 0 in 0.282s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a6e2ad-58fd-4447-b56c-d515394ba359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0906b76d-bd61-4644-9d6a-9671308d7479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Volume volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 (cb11b4f4-363e-449c-b72f-e5b5f7c401d1): created successfully Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0906b76d-bd61-4644-9d6a-9671308d7479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Flow 'volume_create_manager' (5509938d-0840-4ccc-81aa-b3564fed71a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:17 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-10d51b3c-00fc-4456-b4be-77beac9b5d02 req-facf964f-474c-47ba-a48c-6a604598e426 tempest-VolumesSnapshotsTestJSON-817562311 None] Created volume successfully. Sep 07 16:42:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Creating offline snapshot c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d of volume cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:42:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[104c154e-83b4-406e-897a-37684a4b4aef]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:42:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:19 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 Sep 07 16:42:19 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:19 devstack cinder-volume[87492]: WARNING py.warnings [req-1518390f-d6bc-4425-b6ce-045ee72d0b71 req-4642dd6e-e78e-4224-bdde-69fbf83bc4e1 tempest-DeleteServersTestJSON-224722190 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 07 16:42:19 devstack cinder-volume[87492]: .first() Sep 07 16:42:19 devstack cinder-volume[87492]: Sep 07 16:42:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1518390f-d6bc-4425-b6ce-045ee72d0b71 req-4642dd6e-e78e-4224-bdde-69fbf83bc4e1 tempest-DeleteServersTestJSON-224722190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:20 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" returned: 0 in 0.618s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:20 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d 1G Sep 07 16:42:20 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:20 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d 1G" returned: 0 in 0.460s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:20 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d Sep 07 16:42:20 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:20 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" returned: 0 in 0.361s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:20 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d is being set with open permissions: ugo+rw Sep 07 16:42:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:20 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d Sep 07 16:42:20 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:21 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" returned: 0 in 0.386s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:21 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.info Sep 07 16:42:21 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:21 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.info" returned: 0 in 0.398s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:21 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.info is being set with open permissions: ugo+rw Sep 07 16:42:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:21 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.info Sep 07 16:42:21 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:22 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.info" returned: 0 in 0.433s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1518390f-d6bc-4425-b6ce-045ee72d0b71 req-4642dd6e-e78e-4224-bdde-69fbf83bc4e1 tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.283s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1518390f-d6bc-4425-b6ce-045ee72d0b71 req-4642dd6e-e78e-4224-bdde-69fbf83bc4e1 tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-463fc1d4-87c7-481d-b8c2-c41f02d3fa80 req-8fef9557-7815-4237-b20a-e4fd2332a6c9 tempest-VolumesSnapshotsTestJSON-817562311 None] Create snapshot completed successfully Sep 07 16:42:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-1518390f-d6bc-4425-b6ce-045ee72d0b71 req-4642dd6e-e78e-4224-bdde-69fbf83bc4e1 tempest-DeleteServersTestJSON-224722190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-275fa88b-6011-4188-a3dc-398fa528dc53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8016d6d-eb2e-4aa8-bf3e-ff04372a6cd0', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:42:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-1518390f-d6bc-4425-b6ce-045ee72d0b71 req-4642dd6e-e78e-4224-bdde-69fbf83bc4e1 tempest-DeleteServersTestJSON-224722190 None] attachment_update completed successfully. Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "cinder-c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "cinder-quobyte-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-quobyte-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "cinder-quobyte-c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-quobyte-c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Deleting offline snapshot c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d of volume cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] snapshot_file for this snap is: volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[24358df6-e68a-40c6-9d28-9f683bd115c4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:42:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:23 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d Sep 07 16:42:23 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:24 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" returned: 0 in 0.778s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:42:24 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f27222-4647-43a1-8370-0c19a107f965]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:42:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:24 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 Sep 07 16:42:24 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:25 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" returned: 0 in 0.758s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:25 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d Sep 07 16:42:25 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:25 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" returned: 0 in 0.572s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:25 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d Sep 07 16:42:25 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:26 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1.c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" returned: 0 in 0.334s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-quobyte-c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d" released by "_delete_snapshot" :: held 2.610s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:42:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-quobyte-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" released by "delete_snapshot" :: held 2.672s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:42:26 devstack cinder-volume[87492]: WARNING cinder.quota [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:42:26 devstack cinder-volume[87492]: DEBUG cinder.quota [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Created reservations ['ed06d6d2-98f2-4b62-9933-6ceb1fe2d3c6', 'b41fdd93-5562-4bb3-9d66-a3d39f13d286', '9502da7d-ccd2-41a1-9553-9a6965569ab8', 'd2d7ad24-a4a2-4850-a0d9-8b54347e28cc'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:42:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Delete snapshot completed successfully. Sep 07 16:42:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-acb4254b-e947-4e67-84fd-3e05eda9f868 req-661b6a15-4f30-4f86-8ce0-3d096de500d3 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-c9e40b61-20a9-4f89-9a2c-e5f3eda49d1d-delete_snapshot" released by "delete_snapshot" :: held 2.906s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:42:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-9a0a5a36-8ac9-4644-b6bd-1f177d8295b5 req-73ff609d-036f-49e7-acef-dea4ad4cdd85 tempest-DeleteServersTestJSON-224722190 None] Terminate volume connection completed successfully. Sep 07 16:42:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-9a0a5a36-8ac9-4644-b6bd-1f177d8295b5 req-73ff609d-036f-49e7-acef-dea4ad4cdd85 tempest-DeleteServersTestJSON-224722190 None] Deleting attachment c8016d6d-eb2e-4aa8-bf3e-ff04372a6cd0. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:42:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "cinder-cb11b4f4-363e-449c-b72f-e5b5f7c401d1-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:42:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-cb11b4f4-363e-449c-b72f-e5b5f7c401d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:42:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "cinder-quobyte-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:42:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-quobyte-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" acquired by "delete_volume" :: waited 0.036s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:42:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa84c575-008f-4a4e-b5a0-6f71424907b4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:42:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:27 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 Sep 07 16:42:27 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" returned: 0 in 0.635s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:28 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:28 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1 Sep 07 16:42:28 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:29 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" returned: 0 in 0.674s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-quobyte-cb11b4f4-363e-449c-b72f-e5b5f7c401d1" released by "delete_volume" :: held 1.475s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.quota [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Created reservations ['ec150f2b-06cc-4722-a06b-1f5105f311e3', '2e42c76c-856c-408a-ad21-dfc89d78a13c', '596b1a16-cd54-48fe-85d0-5f386b0e6c99', '80736048-d5b9-4ea4-9d4d-d1b30f999e8f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-fac4210c-e5e2-4493-a1e1-edfe8f4dab96 req-f2853c1f-a0d0-48aa-80d3-009432c1a46c tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-fac4210c-e5e2-4493-a1e1-edfe8f4dab96 req-f2853c1f-a0d0-48aa-80d3-009432c1a46c tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-fac4210c-e5e2-4493-a1e1-edfe8f4dab96 req-f2853c1f-a0d0-48aa-80d3-009432c1a46c tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Acquiring lock "cinder-275fa88b-6011-4188-a3dc-398fa528dc53-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:42:29 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:42:29 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-fac4210c-e5e2-4493-a1e1-edfe8f4dab96 req-f2853c1f-a0d0-48aa-80d3-009432c1a46c tempest-ServerActionsTestOtherA-695842632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-347a739a-95f3-4901-8e14-ae3a31cbb30b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21db01cb-c944-433a-802e-e58f8722b5fc', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Lock "cinder-275fa88b-6011-4188-a3dc-398fa528dc53-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Acquiring lock "cinder-quobyte-275fa88b-6011-4188-a3dc-398fa528dc53" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Lock "cinder-quobyte-275fa88b-6011-4188-a3dc-398fa528dc53" acquired by "delete_volume" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d5dd89-8c02-44ba-a5ef-a4db6a593bb3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-fac4210c-e5e2-4493-a1e1-edfe8f4dab96 req-f2853c1f-a0d0-48aa-80d3-009432c1a46c tempest-ServerActionsTestOtherA-695842632 None] attachment_update completed successfully. Sep 07 16:42:29 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 Sep 07 16:42:29 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:29 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.560s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.manager [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:42:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Deleted volume successfully. Sep 07 16:42:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-1cf7d3e7-430b-46f0-a3a5-f7d756f3a240 req-1e40f323-2dcf-4b54-81a4-bd36bf1a8379 tempest-VolumesSnapshotsTestJSON-817562311 None] Lock "cinder-cb11b4f4-363e-449c-b72f-e5b5f7c401d1-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:42:30 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53" returned: 0 in 0.749s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:30 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53 Sep 07 16:42:30 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:30 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-275fa88b-6011-4188-a3dc-398fa528dc53" returned: 0 in 0.455s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Lock "cinder-quobyte-275fa88b-6011-4188-a3dc-398fa528dc53" released by "delete_volume" :: held 1.270s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:42:30 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Created reservations ['a88c508c-a984-46fd-b628-8c9609a344b3', '218e9b13-b663-49c2-b5fb-ffa629831c77', '5fb484d8-b022-4b47-bf91-851d007103ef', '68967431-b0d3-4aab-b306-64cc185bd503'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:31 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:42:31 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:31 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.307s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:42:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Deleted volume successfully. Sep 07 16:42:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f31e5de8-3a87-488f-9109-1212d9223b3b tempest-DeleteServersTestJSON-224722190 None] Lock "cinder-275fa88b-6011-4188-a3dc-398fa528dc53-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:42:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:42:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:42:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:42:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:33 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:42:33 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:34 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.617s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:34 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:42:34 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:42:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 8 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:42:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:42:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-a3805e12-eb49-4fa1-bfde-4581c6df37d9 req-2106a3a9-01ad-4379-95e7-0169437fe7bd tempest-ServerActionsTestOtherA-695842632 None] Terminate volume connection completed successfully. Sep 07 16:42:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-a3805e12-eb49-4fa1-bfde-4581c6df37d9 req-2106a3a9-01ad-4379-95e7-0169437fe7bd tempest-ServerActionsTestOtherA-695842632 None] Deleting attachment 21db01cb-c944-433a-802e-e58f8722b5fc. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:42:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-a3805e12-eb49-4fa1-bfde-4581c6df37d9 req-a2230460-e789-4f6e-86e9-e4ff58accb7f tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-a3805e12-eb49-4fa1-bfde-4581c6df37d9 req-a2230460-e789-4f6e-86e9-e4ff58accb7f tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-a3805e12-eb49-4fa1-bfde-4581c6df37d9 req-a2230460-e789-4f6e-86e9-e4ff58accb7f tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-a3805e12-eb49-4fa1-bfde-4581c6df37d9 req-a2230460-e789-4f6e-86e9-e4ff58accb7f tempest-ServerActionsTestOtherA-695842632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-347a739a-95f3-4901-8e14-ae3a31cbb30b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94ec9092-daf7-4e86-b5ef-84905c3342b5', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:42:38 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-a3805e12-eb49-4fa1-bfde-4581c6df37d9 req-a2230460-e789-4f6e-86e9-e4ff58accb7f tempest-ServerActionsTestOtherA-695842632 None] attachment_update completed successfully. Sep 07 16:42:48 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=44,cinder:INSERT=10,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:42:48 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=32,cinder:SELECT=45,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Flow 'volume_create_manager' (393f7d00-7487-4a8f-b37b-8cac83d1f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4398a3-c884-40fa-85f5-3129e0c2cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4398a3-c884-40fa-85f5-3129e0c2cece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-470493789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620d9145-5d1e-47db-be08-5669adac2ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feedd4933b8844528385e3233aad1ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:53Z,use_quota=True,user_id='e4f206768bd7495d9edf63b9a45d5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cad437c-6104-4bb4-9001-1e21e46fb1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cad437c-6104-4bb4-9001-1e21e46fb1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481ca284-3b4a-49e2-9ee8-c8c8be13baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481ca284-3b4a-49e2-9ee8-c8c8be13baf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620d9145-5d1e-47db-be08-5669adac2ed2', 'volume_name': 'volume-620d9145-5d1e-47db-be08-5669adac2ed2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6230bba2-cb56-4c5e-9df4-ca7cd3eeba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6230bba2-cb56-4c5e-9df4-ca7cd3eeba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7ae12-5b25-4281-9346-66bc6083174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Volume 620d9145-5d1e-47db-be08-5669adac2ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620d9145-5d1e-47db-be08-5669adac2ed2', 'volume_size': 1} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-470493789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620d9145-5d1e-47db-be08-5669adac2ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feedd4933b8844528385e3233aad1ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:53Z,use_quota=True,user_id='e4f206768bd7495d9edf63b9a45d5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Creating volume 620d9145-5d1e-47db-be08-5669adac2ed2 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:42:53 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:42:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:53 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 1073741824 Sep 07 16:42:53 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:53 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 1073741824" returned: 0 in 0.550s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:54 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 Sep 07 16:42:54 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:54 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2" returned: 0 in 0.344s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc7ae12-5b25-4281-9346-66bc6083174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620d9145-5d1e-47db-be08-5669adac2ed2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe9c725-a8c4-410b-a72d-78ad7dda0104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:54 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Volume volume-620d9145-5d1e-47db-be08-5669adac2ed2 (620d9145-5d1e-47db-be08-5669adac2ed2): created successfully Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe9c725-a8c4-410b-a72d-78ad7dda0104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Flow 'volume_create_manager' (393f7d00-7487-4a8f-b37b-8cac83d1f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:54 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6ac534eb-0540-4b26-b414-dfa8fcb0a97b tempest-ServersNegativeTestJSON-1668904908 None] Created volume successfully. Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Flow 'volume_create_manager' (05ddf5eb-f523-48e0-995b-ca641233a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ff00fb-f46a-40b2-bf0b-75488aa3d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ff00fb-f46a-40b2-bf0b-75488aa3d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-5124102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab42a7f3-b4fc-415f-ac1c-212f33946a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feedd4933b8844528385e3233aad1ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:57Z,use_quota=True,user_id='e4f206768bd7495d9edf63b9a45d5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4598d9-9953-4169-bd04-6e3c60f6c4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4598d9-9953-4169-bd04-6e3c60f6c4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02e65b1-3223-4ac6-911a-1771c2c0f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02e65b1-3223-4ac6-911a-1771c2c0f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab42a7f3-b4fc-415f-ac1c-212f33946a75', 'volume_name': 'volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f7fc6f-3adf-4d38-9bc1-14f95530e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f7fc6f-3adf-4d38-9bc1-14f95530e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6aed4b7-8326-4bca-8cee-7814c758d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:57 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Volume ab42a7f3-b4fc-415f-ac1c-212f33946a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75', 'volume_size': 1} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-5124102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab42a7f3-b4fc-415f-ac1c-212f33946a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feedd4933b8844528385e3233aad1ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:42:57Z,use_quota=True,user_id='e4f206768bd7495d9edf63b9a45d5f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Creating volume ab42a7f3-b4fc-415f-ac1c-212f33946a75 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:42:57 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:42:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:57 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 1073741824 Sep 07 16:42:57 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:58 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 1073741824" returned: 0 in 0.581s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:42:58 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 Sep 07 16:42:58 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:42:58 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75" returned: 0 in 0.257s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6aed4b7-8326-4bca-8cee-7814c758d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc68c3b-07cf-4405-ae4a-c6da1b11c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:42:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Volume volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 (ab42a7f3-b4fc-415f-ac1c-212f33946a75): created successfully Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc68c3b-07cf-4405-ae4a-c6da1b11c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:42:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Flow 'volume_create_manager' (05ddf5eb-f523-48e0-995b-ca641233a28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:42:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2ac0d588-d2ca-47f0-903f-ce579cfd596f tempest-ServersNegativeTestJSON-1668904908 None] Created volume successfully. Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "cinder-ab42a7f3-b4fc-415f-ac1c-212f33946a75-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-ab42a7f3-b4fc-415f-ac1c-212f33946a75-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "cinder-quobyte-ab42a7f3-b4fc-415f-ac1c-212f33946a75" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-quobyte-ab42a7f3-b4fc-415f-ac1c-212f33946a75" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85f31b5-063f-4cef-8025-60b3f5c9bd31]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:00 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 Sep 07 16:43:00 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:00 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75" returned: 0 in 0.424s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:00 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75 Sep 07 16:43:00 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:01 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ab42a7f3-b4fc-415f-ac1c-212f33946a75" returned: 0 in 0.319s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-quobyte-ab42a7f3-b4fc-415f-ac1c-212f33946a75" released by "delete_volume" :: held 0.795s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Created reservations ['18508d37-fded-46f5-a041-b318419d9145', '0d8d1697-344b-4da1-9df2-fccd7933ed40', '6448e85d-5ecf-4048-af91-3f509a00b696', '8891239a-9e68-49fa-b3e7-a86423f0bf03'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:01 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:43:01 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "cinder-620d9145-5d1e-47db-be08-5669adac2ed2-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-620d9145-5d1e-47db-be08-5669adac2ed2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "cinder-quobyte-620d9145-5d1e-47db-be08-5669adac2ed2" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-quobyte-620d9145-5d1e-47db-be08-5669adac2ed2" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfcb40a-21bc-4204-8ba6-ff9fb65e1016]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:01 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.421s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:43:01 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 Sep 07 16:43:01 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Deleted volume successfully. Sep 07 16:43:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a48b5791-598f-4ef0-bf6a-eafb059459c2 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-ab42a7f3-b4fc-415f-ac1c-212f33946a75-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:02 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2" returned: 0 in 0.459s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:02 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2 Sep 07 16:43:02 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:02 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-620d9145-5d1e-47db-be08-5669adac2ed2" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-quobyte-620d9145-5d1e-47db-be08-5669adac2ed2" released by "delete_volume" :: held 0.764s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Created reservations ['6e3f6f88-c0cd-4c70-8561-281c3e0945da', '8490110e-7516-4f5d-aa26-84e8f6a8fb19', '770c07bd-03a2-4661-9787-4899b136f40a', 'b4aeee52-f3bd-4e0b-b413-0d0a45b3c310'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:02 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:43:02 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:02 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.325s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:43:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Deleted volume successfully. Sep 07 16:43:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-004fc37e-e6b4-4a2e-acc7-58e9c5ac6031 tempest-ServersNegativeTestJSON-1668904908 None] Lock "cinder-620d9145-5d1e-47db-be08-5669adac2ed2-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-93204613-a77d-4971-8f8f-a3d52b71f783 req-fe0e8da4-3fe6-466e-b7c7-3743f71536d9 tempest-ServerActionsTestOtherA-695842632 None] Terminate volume connection completed successfully. Sep 07 16:43:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-93204613-a77d-4971-8f8f-a3d52b71f783 req-fe0e8da4-3fe6-466e-b7c7-3743f71536d9 tempest-ServerActionsTestOtherA-695842632 None] Deleting attachment 94ec9092-daf7-4e86-b5ef-84905c3342b5. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:43:12 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=22,cinder:SELECT=13,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Flow 'volume_create_manager' (75b07da9-9daf-4e7f-87e1-3bbf54248afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8b3e98-2984-465d-b3d3-2c8b950acef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8b3e98-2984-465d-b3d3-2c8b950acef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1124609533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5fdb35-56cb-474a-9807-267fe1fd09c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1dbc8502c2b462797b24f13cce1b5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:18Z,use_quota=True,user_id='9773a3fb287e426a9f1cc2c194838f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(321e98eb-4c54-4fdf-8405-e75ddacd9a7b),volume_type_id=321e98eb-4c54-4fdf-8405-e75ddacd9a7b)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364dbccf-9b47-45c6-aa36-9d0c1f6c98bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364dbccf-9b47-45c6-aa36-9d0c1f6c98bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfd4743-3402-43f3-a4fc-c0c4898bab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfd4743-3402-43f3-a4fc-c0c4898bab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5fdb35-56cb-474a-9807-267fe1fd09c4', 'volume_name': 'volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a766d154-1fce-4955-994e-1376744f26f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a766d154-1fce-4955-994e-1376744f26f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7010ff7-0546-4e2c-8861-2674ce8e1590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Volume 2e5fdb35-56cb-474a-9807-267fe1fd09c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4', 'volume_size': 1} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1124609533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5fdb35-56cb-474a-9807-267fe1fd09c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1dbc8502c2b462797b24f13cce1b5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:18Z,use_quota=True,user_id='9773a3fb287e426a9f1cc2c194838f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(321e98eb-4c54-4fdf-8405-e75ddacd9a7b),volume_type_id=321e98eb-4c54-4fdf-8405-e75ddacd9a7b)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Creating volume 2e5fdb35-56cb-474a-9807-267fe1fd09c4 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:43:17 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:43:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:17 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 1073741824 Sep 07 16:43:17 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:18 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 1073741824" returned: 0 in 0.660s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:18 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 Sep 07 16:43:18 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:18 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4" returned: 0 in 0.365s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7010ff7-0546-4e2c-8861-2674ce8e1590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58881afb-6256-43ad-a780-3744e1e97509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:18 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Volume volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 (2e5fdb35-56cb-474a-9807-267fe1fd09c4): created successfully Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58881afb-6256-43ad-a780-3744e1e97509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Flow 'volume_create_manager' (75b07da9-9daf-4e7f-87e1-3bbf54248afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d56806e3-44b0-44ac-a81e-4177cfcfd773 tempest-VolumeTypesAccessTest-1448000176 None] Created volume successfully. Sep 07 16:43:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Acquiring lock "cinder-2e5fdb35-56cb-474a-9807-267fe1fd09c4-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Lock "cinder-2e5fdb35-56cb-474a-9807-267fe1fd09c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Acquiring lock "cinder-quobyte-2e5fdb35-56cb-474a-9807-267fe1fd09c4" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Lock "cinder-quobyte-2e5fdb35-56cb-474a-9807-267fe1fd09c4" acquired by "delete_volume" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0930f-fe9f-4569-a8d7-b4eb6b9a9ef8]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:20 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 Sep 07 16:43:20 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:20 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4" returned: 0 in 0.511s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:20 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4 Sep 07 16:43:20 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:20 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e5fdb35-56cb-474a-9807-267fe1fd09c4" returned: 0 in 0.323s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Lock "cinder-quobyte-2e5fdb35-56cb-474a-9807-267fe1fd09c4" released by "delete_volume" :: held 0.890s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:20 devstack cinder-volume[87492]: WARNING cinder.quota [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1061512621 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1061512621, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:43:20 devstack cinder-volume[87492]: WARNING cinder.quota [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1061512621 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1061512621, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:43:20 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Created reservations ['f31445da-7a69-4b4e-9224-b5ef4900d6ca', '0a9db934-732c-45ac-ad33-9af7da9b33f9', 'af4a53bd-21c6-4349-9b07-7d6375d62c1d', '19bbf388-7c90-4830-8916-025dfce46936'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:21 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:43:21 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:21 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:43:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Deleted volume successfully. Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-deaa3c0d-0e77-4318-9420-7c6bb390fc46 tempest-VolumeTypesAccessTest-1448000176 None] Lock "cinder-2e5fdb35-56cb-474a-9807-267fe1fd09c4-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Flow 'volume_create_manager' (b57ba6e9-8cde-4b16-bbff-920acab3f452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463f01d0-e075-4e14-b016-cbd8935af852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463f01d0-e075-4e14-b016-cbd8935af852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1415701699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcf4763-fdd6-4624-b6e2-88c763995f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4bb2e0414143c5a24286ad741937c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:22Z,use_quota=True,user_id='a88d578181874351b62f0314e7269315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2455e09-4ccd-46bf-9787-e6352f390625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2455e09-4ccd-46bf-9787-e6352f390625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e36c0e5-9fbe-4324-b420-48547bb9d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:21 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e36c0e5-9fbe-4324-b420-48547bb9d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2dcf4763-fdd6-4624-b6e2-88c763995f00', 'volume_name': 'volume-2dcf4763-fdd6-4624-b6e2-88c763995f00', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063c27da-55b7-40b2-96b2-e75146b11a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063c27da-55b7-40b2-96b2-e75146b11a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8fb3c4-9ecb-4c25-a096-b3cefbe526d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:22 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Volume 2dcf4763-fdd6-4624-b6e2-88c763995f00: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2dcf4763-fdd6-4624-b6e2-88c763995f00', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Trying to clone 2dcf4763-fdd6-4624-b6e2-88c763995f00 from image cd35955c-2cfe-436b-a709-f0de1afb8856 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:43:22 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Image download 20.69 MB at 20.69 MB/s Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b8ee05-e771-4d3a-85ea-ca257ea28851]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Flow 'volume_create_manager' (8e6d946e-d49e-4299-b592-2961e7e63fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa4000b-9c9d-4872-b9d8-86a9934d9055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa4000b-9c9d-4872-b9d8-86a9934d9055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1426720759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ea653f-fd51-4204-be21-91f21183edba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc55f79873e746b4ae686bcfa4558863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:23Z,use_quota=True,user_id='c9cce8a757b14849ac91528c5b0792b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:22 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe5e870-70f7-4ffc-aa7a-d065c781e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:22 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe5e870-70f7-4ffc-aa7a-d065c781e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee91d76-a424-4c44-aaae-7b2c36c596c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee91d76-a424-4c44-aaae-7b2c36c596c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ea653f-fd51-4204-be21-91f21183edba', 'volume_name': 'volume-c8ea653f-fd51-4204-be21-91f21183edba', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bafc16f-cd81-48a7-a6ad-976d6e2720ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bafc16f-cd81-48a7-a6ad-976d6e2720ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0741efdc-1ddf-4158-b02a-21e6a77cc23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:22 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Volume c8ea653f-fd51-4204-be21-91f21183edba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ea653f-fd51-4204-be21-91f21183edba', 'volume_size': 1} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1426720759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ea653f-fd51-4204-be21-91f21183edba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc55f79873e746b4ae686bcfa4558863',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:23Z,use_quota=True,user_id='c9cce8a757b14849ac91528c5b0792b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Creating volume c8ea653f-fd51-4204-be21-91f21183edba {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:43:22 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:43:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:23 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba 1073741824 Sep 07 16:43:23 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:23 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 is fetched for user a88d578181874351b62f0314e7269315. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd77830-4634-48c7-9309-923a0b89b885]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:23 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD Sep 07 16:43:23 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:23 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba 1073741824" returned: 0 in 0.509s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:23 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba Sep 07 16:43:23 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:23 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:23 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba" returned: 0 in 0.325s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1415701699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dcf4763-fdd6-4624-b6e2-88c763995f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4bb2e0414143c5a24286ad741937c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:22Z,use_quota=True,user_id='a88d578181874351b62f0314e7269315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Creating volume 2dcf4763-fdd6-4624-b6e2-88c763995f00 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:43:23 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0741efdc-1ddf-4158-b02a-21e6a77cc23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ea653f-fd51-4204-be21-91f21183edba', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a664b-34d4-4a09-8e50-64749ad0062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:23 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 1073741824 Sep 07 16:43:23 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:23 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Volume volume-c8ea653f-fd51-4204-be21-91f21183edba (c8ea653f-fd51-4204-be21-91f21183edba): created successfully Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6a664b-34d4-4a09-8e50-64749ad0062a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Flow 'volume_create_manager' (8e6d946e-d49e-4299-b592-2961e7e63fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c1e8744a-eff5-48c9-84fd-40345a464e65 tempest-TaggedAttachmentsTest-339607739 None] Created volume successfully. Sep 07 16:43:24 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 1073741824" returned: 0 in 0.555s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:24 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 Sep 07 16:43:24 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:25 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00" returned: 0 in 0.522s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Attempting download of cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume 2dcf4763-fdd6-4624-b6e2-88c763995f00. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b089a6-4c62-42b5-bd1f-d229e20d569c]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_56hzq353 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:25 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_56hzq353 Sep 07 16:43:25 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:25 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_56hzq353" returned: 0 in 0.405s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_56hzq353 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:25 devstack sudo[91350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_56hzq353 Sep 07 16:43:25 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:25 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_56hzq353" returned: 1 in 0.431s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_56hzq353' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de97287-1b7a-4097-9b8e-7c07eaad3b4c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:26 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD Sep 07 16:43:26 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:26 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:26 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] cd35955c-2cfe-436b-a709-f0de1afb8856 was qcow2, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:43:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:26 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 Sep 07 16:43:26 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:28 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00" returned: 0 in 2.427s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:28 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_rkp3k964devstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:43:28 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Converted 112.00 MB image at 46.13 MB/s Sep 07 16:43:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:28 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 1G Sep 07 16:43:28 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:29 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 1G" returned: 0 in 0.380s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Downloaded image cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume 2dcf4763-fdd6-4624-b6e2-88c763995f00 successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 for user a88d578181874351b62f0314e7269315 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Marking volume 2dcf4763-fdd6-4624-b6e2-88c763995f00 as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Copying metadata from image cd35955c-2cfe-436b-a709-f0de1afb8856 to 2dcf4763-fdd6-4624-b6e2-88c763995f00. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Creating volume glance metadata for volume 2dcf4763-fdd6-4624-b6e2-88c763995f00 backed by image cd35955c-2cfe-436b-a709-f0de1afb8856 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8fb3c4-9ecb-4c25-a096-b3cefbe526d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dcf4763-fdd6-4624-b6e2-88c763995f00', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b6105b-b545-42e2-97fb-5ae47520a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Volume volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 (2dcf4763-fdd6-4624-b6e2-88c763995f00): created successfully Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b6105b-b545-42e2-97fb-5ae47520a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Flow 'volume_create_manager' (b57ba6e9-8cde-4b16-bbff-920acab3f452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-21cc0888-e7af-469e-b303-230d71bb6ebb tempest-ServerActionsTestOtherA-695842632 None] Created volume successfully. Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:33 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:43:33 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:33 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.521s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-7051ee80-57f0-4e7b-bc10-b733ec47ee41 req-53327935-e40e-441d-9c4e-6ba9a4f70cfe tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-7051ee80-57f0-4e7b-bc10-b733ec47ee41 req-53327935-e40e-441d-9c4e-6ba9a4f70cfe tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-7051ee80-57f0-4e7b-bc10-b733ec47ee41 req-53327935-e40e-441d-9c4e-6ba9a4f70cfe tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-7051ee80-57f0-4e7b-bc10-b733ec47ee41 req-53327935-e40e-441d-9c4e-6ba9a4f70cfe tempest-ServerActionsTestOtherA-695842632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-2dcf4763-fdd6-4624-b6e2-88c763995f00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0feb2171-28b8-4fb4-b9af-bb418cab5550', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Flow 'volume_create_manager' (d2b08888-9473-48d8-9224-519dba8ad64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f91194c-b815-468a-9a61-131a7676d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:35 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-7051ee80-57f0-4e7b-bc10-b733ec47ee41 req-53327935-e40e-441d-9c4e-6ba9a4f70cfe tempest-ServerActionsTestOtherA-695842632 None] attachment_update completed successfully. Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f91194c-b815-468a-9a61-131a7676d999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1982424821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1139557-799d-4fcc-a8ca-f62d95c808ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac3d76a242495ab32c93571f7d2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:35Z,use_quota=True,user_id='1a856231c2e140e6a5e90e881ef5802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b811b2ec-8c45-4587-b743-211845475ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b811b2ec-8c45-4587-b743-211845475ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf0f65-57d7-4c79-9881-a6c04514b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf0f65-57d7-4c79-9881-a6c04514b87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1139557-799d-4fcc-a8ca-f62d95c808ad', 'volume_name': 'volume-a1139557-799d-4fcc-a8ca-f62d95c808ad', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d445bd-879b-4564-8939-7ebf851f44e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d445bd-879b-4564-8939-7ebf851f44e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4a8ec2-4db4-4f57-8b59-bd64774c5b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:35 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Volume a1139557-799d-4fcc-a8ca-f62d95c808ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1139557-799d-4fcc-a8ca-f62d95c808ad', 'volume_size': 1} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1982424821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1139557-799d-4fcc-a8ca-f62d95c808ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac3d76a242495ab32c93571f7d2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:43:35Z,use_quota=True,user_id='1a856231c2e140e6a5e90e881ef5802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Creating volume a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:43:35 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:43:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:35 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad 1073741824 Sep 07 16:43:35 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:36 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad 1073741824" returned: 0 in 0.686s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:36 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad Sep 07 16:43:36 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:36 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad" returned: 0 in 0.299s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4a8ec2-4db4-4f57-8b59-bd64774c5b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1139557-799d-4fcc-a8ca-f62d95c808ad', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7c16b6-58b4-4c29-a3a6-f04d0d49a4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:43:36 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Volume volume-a1139557-799d-4fcc-a8ca-f62d95c808ad (a1139557-799d-4fcc-a8ca-f62d95c808ad): created successfully Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7c16b6-58b4-4c29-a3a6-f04d0d49a4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:43:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Flow 'volume_create_manager' (d2b08888-9473-48d8-9224-519dba8ad64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:43:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-356cf713-c693-422a-b5dc-15db16f33d51 tempest-VolumesDeleteCascade-263835691 None] Created volume successfully. Sep 07 16:43:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Creating offline snapshot 3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 of volume a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:43:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[84178722-d8fe-4601-a7a9-db33ea8dd922]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:37 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad Sep 07 16:43:37 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:38 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad" returned: 0 in 0.447s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:38 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 1G Sep 07 16:43:38 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:38 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 1G" returned: 0 in 0.630s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1139557-799d-4fcc-a8ca-f62d95c808ad -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:38 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1139557-799d-4fcc-a8ca-f62d95c808ad -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 Sep 07 16:43:38 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:39 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1139557-799d-4fcc-a8ca-f62d95c808ad -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" returned: 0 in 0.639s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:39 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 is being set with open permissions: ugo+rw Sep 07 16:43:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:39 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 Sep 07 16:43:39 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:39 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" returned: 0 in 0.358s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:39 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.info Sep 07 16:43:39 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:40 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.info" returned: 0 in 0.474s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:40 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.info is being set with open permissions: ugo+rw Sep 07 16:43:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:40 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.info Sep 07 16:43:40 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:40 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.info" returned: 0 in 0.439s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.227s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1a7a829b-5139-4c49-aea1-4e6ba3829af6 tempest-VolumesDeleteCascade-263835691 None] Create snapshot completed successfully Sep 07 16:43:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:43:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:43:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Creating offline snapshot 3c05beec-f00c-4c9e-8ad3-56e3e9233e7a of volume a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:43:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d403f-8373-40a8-9e9c-2e29d11a6cea]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:43 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 Sep 07 16:43:43 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:43 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" returned: 0 in 0.759s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1139557-799d-4fcc-a8ca-f62d95c808ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:43:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:43 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a 1G Sep 07 16:43:43 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:44 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a 1G" returned: 0 in 0.747s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:44 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a Sep 07 16:43:44 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:45 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" returned: 0 in 0.829s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:45 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a is being set with open permissions: ugo+rw Sep 07 16:43:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:45 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a Sep 07 16:43:45 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:45 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" returned: 0 in 0.653s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:43:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-57442879-18f5-4c3d-9ca2-c8bbd68b6d8f tempest-VolumesDeleteCascade-263835691 None] Create snapshot completed successfully Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-a1139557-799d-4fcc-a8ca-f62d95c808ad-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-a1139557-799d-4fcc-a8ca-f62d95c808ad-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Performing cascade delete. {{(pid=87492) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-3c05beec-f00c-4c9e-8ad3-56e3e9233e7a-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-3c05beec-f00c-4c9e-8ad3-56e3e9233e7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Deleting offline snapshot 3c05beec-f00c-4c9e-8ad3-56e3e9233e7a of volume a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] snapshot_file for this snap is: volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8653040-fe3c-4e66-9d6b-56a4d1209ac5]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:47 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a Sep 07 16:43:47 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:48 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" returned: 0 in 0.690s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1139557-799d-4fcc-a8ca-f62d95c808ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:43:48 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfb8d5d-bb76-4418-9509-e048cc0f60eb]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:48 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 Sep 07 16:43:48 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:49 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" returned: 0 in 0.947s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1139557-799d-4fcc-a8ca-f62d95c808ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:43:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:49 devstack sudo[92019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a Sep 07 16:43:49 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:50 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=52,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:43:50 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" returned: 0 in 1.495s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:50 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a Sep 07 16:43:50 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:51 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" returned: 0 in 0.861s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-3c05beec-f00c-4c9e-8ad3-56e3e9233e7a" released by "_delete_snapshot" :: held 4.244s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" released by "delete_snapshot" :: held 4.286s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:51 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Created reservations ['13c5bf60-a33a-4aad-8262-f57398a928e5', '00fa24c9-0cab-4584-833a-e06236aece15', 'b6e7d0bb-400b-4e41-8d55-41e6562d66c3', '222d25d3-9255-4b79-acfd-72863c4c2835'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:43:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Delete snapshot completed successfully. Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-3c05beec-f00c-4c9e-8ad3-56e3e9233e7a-delete_snapshot" released by "delete_snapshot" :: held 4.693s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" acquired by "delete_snapshot" :: waited 0.101s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Deleting offline snapshot 3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 of volume a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] snapshot_file for this snap is: volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0e530b-41f2-4710-be3e-9d3705429b38]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:52 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 Sep 07 16:43:52 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:53 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" returned: 0 in 1.381s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1139557-799d-4fcc-a8ca-f62d95c808ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:43:54 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9232b8e-abe6-4247-94e7-50d56ae80262]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:54 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad Sep 07 16:43:54 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:55 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad" returned: 0 in 1.400s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:55 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 Sep 07 16:43:55 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:56 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" returned: 0 in 1.035s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:56 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9 Sep 07 16:43:56 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:57 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad.3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" returned: 0 in 0.679s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9" released by "_delete_snapshot" :: held 4.741s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" released by "delete_snapshot" :: held 4.827s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Created reservations ['2b96efa4-a68d-4ab1-a8dd-31ec204bde75', 'd7c5e204-1d75-4e89-bf2c-618788c27918', 'a19b9ea3-a81a-4b1d-96c6-b4bb1d7b86d6', '64e34d84-ab74-4f1b-99c2-10f07137bc0f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:43:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Delete snapshot completed successfully. Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-3d704fdc-9fb9-4353-b5ee-eb0dfe3757f9-delete_snapshot" released by "delete_snapshot" :: held 5.284s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Snapshots deleted, issuing volume delete {{(pid=87492) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d517ed5-7a7c-4919-a091-ed17b46cd2d3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:43:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:57 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad Sep 07 16:43:57 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:58 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad" returned: 0 in 0.898s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:43:58 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad Sep 07 16:43:58 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:43:59 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Sep 07 16:43:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a1139557-799d-4fcc-a8ca-f62d95c808ad" returned: 0 in 1.094s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:43:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-a1139557-799d-4fcc-a8ca-f62d95c808ad" released by "delete_volume" :: held 2.125s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:43:59 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Created reservations ['6c7d0b6b-916e-4058-bf5c-a14b1b52a298', '16fc35d0-c886-4c6a-9204-2e5082d525b3', '9622ca72-243b-45db-ad45-b9af957b2cea', 'a7a26114-4cbb-4628-98d4-8fcebb143370'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:00 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:00 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:00 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.734s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Deleted volume successfully. Sep 07 16:44:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5fa551ea-724d-473e-9a4e-42b2a2c790fb tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-a1139557-799d-4fcc-a8ca-f62d95c808ad-delete_volume" released by "delete_volume" :: held 13.688s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Flow 'volume_create_manager' (9da5c15e-08fe-436b-8011-f460b5937e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0bdb27-1a8d-4135-a65e-f861433c02dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0bdb27-1a8d-4135-a65e-f861433c02dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1145056950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a48f13-1634-4a91-9f4a-dc7156c5ebf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac3d76a242495ab32c93571f7d2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:02Z,use_quota=True,user_id='1a856231c2e140e6a5e90e881ef5802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c57184-a9d7-43b6-806b-9064a0f78d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c57184-a9d7-43b6-806b-9064a0f78d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9672361-a0d8-4c63-8b2f-71f23787fec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9672361-a0d8-4c63-8b2f-71f23787fec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a48f13-1634-4a91-9f4a-dc7156c5ebf6', 'volume_name': 'volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3868d87e-31d8-462d-9e36-b339e726ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3868d87e-31d8-462d-9e36-b339e726ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8022d508-0c9a-4411-81e8-236c46861462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:01 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Volume d4a48f13-1634-4a91-9f4a-dc7156c5ebf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6', 'volume_size': 1} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1145056950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a48f13-1634-4a91-9f4a-dc7156c5ebf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac3d76a242495ab32c93571f7d2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:02Z,use_quota=True,user_id='1a856231c2e140e6a5e90e881ef5802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Creating volume d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:44:01 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:44:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:01 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 1073741824 Sep 07 16:44:01 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:02 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 1073741824" returned: 0 in 0.857s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:02 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 Sep 07 16:44:02 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-0b3f1d4a-a907-48a0-935d-c6508ecaf071 req-2f85aa1e-51c5-47f9-b07d-238a85b74b42 tempest-ServerActionsTestOtherA-695842632 None] Terminate volume connection completed successfully. Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-0b3f1d4a-a907-48a0-935d-c6508ecaf071 req-2f85aa1e-51c5-47f9-b07d-238a85b74b42 tempest-ServerActionsTestOtherA-695842632 None] Deleting attachment 0feb2171-28b8-4fb4-b9af-bb418cab5550. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:44:03 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" returned: 0 in 0.469s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8022d508-0c9a-4411-81e8-236c46861462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48eb4ea-501d-4299-a869-77324046a4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Volume volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 (d4a48f13-1634-4a91-9f4a-dc7156c5ebf6): created successfully Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48eb4ea-501d-4299-a869-77324046a4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Flow 'volume_create_manager' (9da5c15e-08fe-436b-8011-f460b5937e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9e08a397-d047-4db9-a344-28a428c923ad tempest-VolumesDeleteCascade-263835691 None] Created volume successfully. Sep 07 16:44:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Creating offline snapshot 919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 of volume d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:44:04 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de0830d-b272-4491-8c16-c8cf3c6abad9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:04 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 Sep 07 16:44:04 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:04 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" returned: 0 in 0.356s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:04 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 1G Sep 07 16:44:04 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:05 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 1G" returned: 0 in 0.525s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-0b3f1d4a-a907-48a0-935d-c6508ecaf071 req-3884bb23-c8ff-4ec1-a937-95b656b41d04 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:05 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 Sep 07 16:44:05 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:05 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" returned: 0 in 0.309s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:05 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 is being set with open permissions: ugo+rw Sep 07 16:44:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:05 devstack sudo[92264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 Sep 07 16:44:05 devstack sudo[92264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:05 devstack sudo[92264]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:05 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.info Sep 07 16:44:05 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:06 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.info" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:06 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.info is being set with open permissions: ugo+rw Sep 07 16:44:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:06 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.info Sep 07 16:44:06 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:06 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.info" returned: 0 in 0.267s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-0b3f1d4a-a907-48a0-935d-c6508ecaf071 req-3884bb23-c8ff-4ec1-a937-95b656b41d04 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.129s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-0b3f1d4a-a907-48a0-935d-c6508ecaf071 req-3884bb23-c8ff-4ec1-a937-95b656b41d04 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1c15d119-b67f-4c38-bdf6-3ee55ff45acd tempest-VolumesDeleteCascade-263835691 None] Create snapshot completed successfully Sep 07 16:44:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-0b3f1d4a-a907-48a0-935d-c6508ecaf071 req-3884bb23-c8ff-4ec1-a937-95b656b41d04 tempest-ServerActionsTestOtherA-695842632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-2dcf4763-fdd6-4624-b6e2-88c763995f00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66ee24db-2cbb-4d07-a188-75ebaaad888e', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:44:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-0b3f1d4a-a907-48a0-935d-c6508ecaf071 req-3884bb23-c8ff-4ec1-a937-95b656b41d04 tempest-ServerActionsTestOtherA-695842632 None] attachment_update completed successfully. Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Flow 'volume_create_manager' (0d2e9f82-4ea8-4d87-b1c0-84e30d42855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e6837f-0d46-4634-aa79-c9755a99688f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e6837f-0d46-4634-aa79-c9755a99688f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1656017158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128bef40-bd33-4134-a157-bf959a07df87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ac3d76a242495ab32c93571f7d2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:08Z,use_quota=True,user_id='1a856231c2e140e6a5e90e881ef5802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1725ae66-a58d-4493-a7d9-f912795cb070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1725ae66-a58d-4493-a7d9-f912795cb070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b212538d-2205-45c0-8e44-c08208be0c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b212538d-2205-45c0-8e44-c08208be0c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '128bef40-bd33-4134-a157-bf959a07df87', 'volume_name': 'volume-128bef40-bd33-4134-a157-bf959a07df87', 'volume_size': 1, 'snapshot_id': '919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90aa443-a74e-4d3c-9358-3e8d8a9f4ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90aa443-a74e-4d3c-9358-3e8d8a9f4ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8659f4-1542-4086-a94f-43a7b205747d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:08 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Volume 128bef40-bd33-4134-a157-bf959a07df87: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-128bef40-bd33-4134-a157-bf959a07df87', 'volume_size': 1, 'snapshot_id': '919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0'} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0-128bef40-bd33-4134-a157-bf959a07df87" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0-128bef40-bd33-4134-a157-bf959a07df87" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Creating volume 128bef40-bd33-4134-a157-bf959a07df87 from snapshot 919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-128bef40-bd33-4134-a157-bf959a07df87" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-128bef40-bd33-4134-a157-bf959a07df87" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] snapshot: 919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0, volume: 128bef40-bd33-4134-a157-bf959a07df87, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e897c58-c313-484d-b2bc-563ebe4d467a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:08 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 Sep 07 16:44:08 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:09 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" returned: 0 in 0.515s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfcb547-7052-4dfa-8029-030f9c953223]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:09 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 Sep 07 16:44:09 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:09 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" returned: 0 in 0.450s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:44:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:09 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 Sep 07 16:44:09 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:17 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87" returned: 0 in 7.568s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:44:17 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Converted 1024.00 MB image at 135.29 MB/s Sep 07 16:44:17 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 is being set with open permissions: ugo+rw Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:17 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 Sep 07 16:44:17 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:17 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87" returned: 0 in 0.384s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-128bef40-bd33-4134-a157-bf959a07df87" released by "_copy_volume_from_snapshot" :: held 9.018s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=67,cinder:UPDATE=50,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0-128bef40-bd33-4134-a157-bf959a07df87" released by "_create_volume_from_snapshot" :: held 9.122s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.140s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8659f4-1542-4086-a94f-43a7b205747d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128bef40-bd33-4134-a157-bf959a07df87', 'volume_size': 1, 'snapshot_id': '919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3e266d-daff-47ee-9f09-ea4a8d3c680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Volume volume-128bef40-bd33-4134-a157-bf959a07df87 (128bef40-bd33-4134-a157-bf959a07df87): created successfully Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3e266d-daff-47ee-9f09-ea4a8d3c680f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Flow 'volume_create_manager' (0d2e9f82-4ea8-4d87-b1c0-84e30d42855a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:17 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0b469fe1-ad30-4ecc-9b59-3512defd163e tempest-VolumesDeleteCascade-263835691 None] Created volume successfully. Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Performing cascade delete. {{(pid=87492) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Deleting offline snapshot 919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 of volume d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] snapshot_file for this snap is: volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e0c9a0-4739-4b73-96c4-fbb8c05977a2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:18 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 Sep 07 16:44:18 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:18 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" returned: 0 in 0.435s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a17a6c-4449-4c27-b081-e9d2f8059f5d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:19 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 Sep 07 16:44:19 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:19 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" returned: 0 in 0.582s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:19 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 Sep 07 16:44:19 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:19 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" returned: 0 in 0.445s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:20 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0 Sep 07 16:44:20 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:20 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6.919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" returned: 0 in 0.344s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0" released by "_delete_snapshot" :: held 1.979s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" released by "delete_snapshot" :: held 2.017s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Created reservations ['c807caa3-14c7-40bf-be06-0c23e0503c05', 'bb0f886e-2cea-420b-9177-a51b35c78498', 'a60040cf-2f9f-4464-a400-1c87446aeae8', '7c5e1882-73a1-44f2-aca5-03ccc1b5562d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:20 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Delete snapshot completed successfully. Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-919ec0c9-ce1e-4ae0-bbfb-efb9e35494b0-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Snapshots deleted, issuing volume delete {{(pid=87492) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d65ec2-a64f-4b5e-8af6-9eb1c2b21c45]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:20 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 Sep 07 16:44:20 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:21 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" returned: 0 in 0.473s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:21 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6 Sep 07 16:44:21 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:21 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" returned: 0 in 0.732s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6" released by "delete_volume" :: held 1.324s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Created reservations ['b64dd6c7-2b46-4517-8d44-efed9ab13979', 'fccafdcb-ad45-4678-a9ca-65f7f82fadac', '2431c65d-89f5-4f7a-b537-7bdf1f37a7a9', 'b3f1de18-2c19-4d82-98a3-9f04b624b7bf'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:22 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:22 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:22 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.473s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Deleted volume successfully. Sep 07 16:44:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02a9b38b-bc95-41f9-b4ef-f8152ad8a6a7 tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-d4a48f13-1634-4a91-9f4a-dc7156c5ebf6-delete_volume" released by "delete_volume" :: held 4.569s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-128bef40-bd33-4134-a157-bf959a07df87-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-128bef40-bd33-4134-a157-bf959a07df87-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "cinder-quobyte-128bef40-bd33-4134-a157-bf959a07df87" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-128bef40-bd33-4134-a157-bf959a07df87" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd1677-6bce-4234-9665-6b66259185f1]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:23 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 Sep 07 16:44:23 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:24 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87" returned: 0 in 0.552s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:24 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87 Sep 07 16:44:24 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Flow 'volume_create_manager' (962b5c0b-fede-43b8-a0ee-9832f0c5680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1846e834-e900-4766-ad76-3a0eac6c03a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1846e834-e900-4766-ad76-3a0eac6c03a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1018447818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e089cc-0226-43cc-b8bc-320fc7db79a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672274b35c5d4ede8fec5b060402514f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:24Z,use_quota=True,user_id='1478b1b0f77e4f8a82cef9509ffde35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c04442-655d-484f-8840-9f33b9d6b34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c04442-655d-484f-8840-9f33b9d6b34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fd8163-728d-402b-b7d0-51f9010cf304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fd8163-728d-402b-b7d0-51f9010cf304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e089cc-0226-43cc-b8bc-320fc7db79a3', 'volume_name': 'volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea14c3c-5829-4527-9cbe-e9b9a144f948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea14c3c-5829-4527-9cbe-e9b9a144f948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24710ff6-6310-464c-8797-1d4e390c0596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:24 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Volume f9e089cc-0226-43cc-b8bc-320fc7db79a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3', 'volume_size': 1} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1018447818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e089cc-0226-43cc-b8bc-320fc7db79a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672274b35c5d4ede8fec5b060402514f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:24Z,use_quota=True,user_id='1478b1b0f77e4f8a82cef9509ffde35a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Creating volume f9e089cc-0226-43cc-b8bc-320fc7db79a3 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:44:24 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:24 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 1073741824 Sep 07 16:44:24 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:24 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-128bef40-bd33-4134-a157-bf959a07df87" returned: 0 in 0.365s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-quobyte-128bef40-bd33-4134-a157-bf959a07df87" released by "delete_volume" :: held 0.995s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Created reservations ['177e1c56-d02a-42d4-b54b-2c5f44d6bfa6', 'd17a2802-efbe-4a41-afc0-32a32b5f3cdc', '567915c8-c5f5-4276-aeb2-2dbc2e6e2dcb', '7f727582-0b92-4ff5-9cc2-684151fc5a71'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:24 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:24 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:24 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:24 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 1073741824" returned: 0 in 0.637s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.311s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:24 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:24 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Deleted volume successfully. Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:25 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 Sep 07 16:44:25 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-269b2081-85e9-4c3a-a5c5-f2029989b74e tempest-VolumesDeleteCascade-263835691 None] Lock "cinder-128bef40-bd33-4134-a157-bf959a07df87-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-7a7ca2ac-724d-4255-80af-71a404ed069c req-8784cc02-c16f-4a5b-9025-2aba469a1157 tempest-TaggedAttachmentsTest-339607739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:25 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3" returned: 0 in 0.306s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-7a7ca2ac-724d-4255-80af-71a404ed069c req-8784cc02-c16f-4a5b-9025-2aba469a1157 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.238s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24710ff6-6310-464c-8797-1d4e390c0596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e27c99-2d26-421c-9db1-f1e51682fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-7a7ca2ac-724d-4255-80af-71a404ed069c req-8784cc02-c16f-4a5b-9025-2aba469a1157 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Volume volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 (f9e089cc-0226-43cc-b8bc-320fc7db79a3): created successfully Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e27c99-2d26-421c-9db1-f1e51682fe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Flow 'volume_create_manager' (962b5c0b-fede-43b8-a0ee-9832f0c5680e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6eaf8354-730c-4fa8-a39f-0914601000b8 tempest-AttachVolumeShelveTestJSON-861181006 None] Created volume successfully. Sep 07 16:44:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-7a7ca2ac-724d-4255-80af-71a404ed069c req-8784cc02-c16f-4a5b-9025-2aba469a1157 tempest-TaggedAttachmentsTest-339607739 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-c8ea653f-fd51-4204-be21-91f21183edba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8e25f16-bb2f-4394-ba1d-49e79b8b45fb', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:44:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-7a7ca2ac-724d-4255-80af-71a404ed069c req-8784cc02-c16f-4a5b-9025-2aba469a1157 tempest-TaggedAttachmentsTest-339607739 None] attachment_update completed successfully. Sep 07 16:44:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-e1707308-1532-4ed6-af67-f10af97b4e52 req-540af72e-e534-4170-a101-79c77764b7d6 tempest-TaggedAttachmentsTest-339607739 None] Terminate volume connection completed successfully. Sep 07 16:44:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-e1707308-1532-4ed6-af67-f10af97b4e52 req-540af72e-e534-4170-a101-79c77764b7d6 tempest-TaggedAttachmentsTest-339607739 None] Deleting attachment b8e25f16-bb2f-4394-ba1d-49e79b8b45fb. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Flow 'volume_create_manager' (ebbb18ab-51f4-4b88-b48f-018ff8f0adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cd8aa6-ed9f-424d-b976-5b7b986769d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cd8aa6-ed9f-424d-b976-5b7b986769d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-133121455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2866be73-313d-49e4-ba91-ff82e902116f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96999de612384b24b68fd4affc83efe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:33Z,use_quota=True,user_id='65f8907e0b714daba08931ad7602c1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee52ecbd-72ad-4c06-bb81-1ab24b680341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:33 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:33 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee52ecbd-72ad-4c06-bb81-1ab24b680341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6260c88e-d4d9-4246-8890-905ed66c3f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6260c88e-d4d9-4246-8890-905ed66c3f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2866be73-313d-49e4-ba91-ff82e902116f', 'volume_name': 'volume-2866be73-313d-49e4-ba91-ff82e902116f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94898afc-6237-4ace-b5b8-40705bec3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94898afc-6237-4ace-b5b8-40705bec3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4e1578-f198-4057-9769-f0de46152359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:33 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Volume 2866be73-313d-49e4-ba91-ff82e902116f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2866be73-313d-49e4-ba91-ff82e902116f', 'volume_size': 1} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-133121455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2866be73-313d-49e4-ba91-ff82e902116f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96999de612384b24b68fd4affc83efe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:33Z,use_quota=True,user_id='65f8907e0b714daba08931ad7602c1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Creating volume 2866be73-313d-49e4-ba91-ff82e902116f {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:44:33 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:33 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f 1073741824 Sep 07 16:44:33 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:33 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.323s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:44:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:44:34 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f 1073741824" returned: 0 in 0.767s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:34 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f Sep 07 16:44:34 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:34 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f" returned: 0 in 0.305s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4e1578-f198-4057-9769-f0de46152359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2866be73-313d-49e4-ba91-ff82e902116f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77ed094-b6f9-434f-80b9-d841bf16a0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:34 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Volume volume-2866be73-313d-49e4-ba91-ff82e902116f (2866be73-313d-49e4-ba91-ff82e902116f): created successfully Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77ed094-b6f9-434f-80b9-d841bf16a0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Flow 'volume_create_manager' (ebbb18ab-51f4-4b88-b48f-018ff8f0adf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-afcabb7d-cd6a-4b08-ab0b-b59fd53f590a tempest-VolumesTransfersTest-901226779 None] Created volume successfully. Sep 07 16:44:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4ca720ae-4e1f-44f2-b723-d74ab596b974 tempest-VolumesTransfersTest-1358467650 None] Transfer volume completed successfully. Sep 07 16:44:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Acquiring lock "cinder-2866be73-313d-49e4-ba91-ff82e902116f-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-2866be73-313d-49e4-ba91-ff82e902116f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Acquiring lock "cinder-quobyte-2866be73-313d-49e4-ba91-ff82e902116f" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-quobyte-2866be73-313d-49e4-ba91-ff82e902116f" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[68818956-4d12-487e-bc35-e17f2767ba33]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:37 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f Sep 07 16:44:37 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:38 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f" returned: 0 in 0.655s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:38 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f Sep 07 16:44:38 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:38 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2866be73-313d-49e4-ba91-ff82e902116f" returned: 0 in 0.286s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-quobyte-2866be73-313d-49e4-ba91-ff82e902116f" released by "delete_volume" :: held 1.011s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Created reservations ['e16c4008-98fc-45de-ad73-ccf3858bacb4', '8ba109fe-7c5d-445a-ab94-2a9da49768ac', '79406f60-7c3d-44c0-8b23-b193c6e66c26', 'e2ed220a-12b9-4a97-924f-a2f4832fccc3'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:38 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:38 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:39 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.279s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:39 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Deleted volume successfully. Sep 07 16:44:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f2b071a-8619-429c-8dc8-e637ea75c561 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-2866be73-313d-49e4-ba91-ff82e902116f-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-1c36aae4-50f0-45d1-9f26-72df3015fbcd req-11dd6a46-853d-4a5c-9b4d-53e27c9fca70 tempest-AttachVolumeShelveTestJSON-861181006 None] No connector for attachment 4d9f255b-9b1a-4a3a-995b-877617645164; skipping storage backend terminate_connection call. {{(pid=87492) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 16:44:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-1c36aae4-50f0-45d1-9f26-72df3015fbcd req-11dd6a46-853d-4a5c-9b4d-53e27c9fca70 tempest-AttachVolumeShelveTestJSON-861181006 None] Deleting attachment 4d9f255b-9b1a-4a3a-995b-877617645164. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Flow 'volume_create_manager' (32bcab7a-e376-4dbb-a4f0-82cbab1188ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b8f52-6abe-4476-a0e4-ba80988775a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b8f52-6abe-4476-a0e4-ba80988775a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-110683389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9cd708-32f3-46c6-8ab7-303c21219f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96999de612384b24b68fd4affc83efe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:40Z,use_quota=True,user_id='65f8907e0b714daba08931ad7602c1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec99afaf-3f25-4933-8e26-9b3cc3407539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec99afaf-3f25-4933-8e26-9b3cc3407539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccc3da1-e46f-46fb-933e-e76b58e31c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccc3da1-e46f-46fb-933e-e76b58e31c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9cd708-32f3-46c6-8ab7-303c21219f7b', 'volume_name': 'volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b331a-6ea4-4a4f-92f6-ce632d58e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0b331a-6ea4-4a4f-92f6-ce632d58e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cfb6d9-cc2a-40bc-bfd2-81aa8bbef0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:40 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Volume 5b9cd708-32f3-46c6-8ab7-303c21219f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b', 'volume_size': 1} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-110683389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9cd708-32f3-46c6-8ab7-303c21219f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96999de612384b24b68fd4affc83efe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:44:40Z,use_quota=True,user_id='65f8907e0b714daba08931ad7602c1a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Creating volume 5b9cd708-32f3-46c6-8ab7-303c21219f7b {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:44:40 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:44:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:40 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b 1073741824 Sep 07 16:44:40 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:41 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b 1073741824" returned: 0 in 0.632s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:41 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b Sep 07 16:44:41 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:41 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b" returned: 0 in 0.425s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cfb6d9-cc2a-40bc-bfd2-81aa8bbef0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa01db3-a17d-44a4-8593-3eeca84bc91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:44:41 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Volume volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b (5b9cd708-32f3-46c6-8ab7-303c21219f7b): created successfully Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa01db3-a17d-44a4-8593-3eeca84bc91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Flow 'volume_create_manager' (32bcab7a-e376-4dbb-a4f0-82cbab1188ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:44:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-36aed544-721c-4f97-a0a1-70f2937993d7 tempest-VolumesTransfersTest-901226779 None] Created volume successfully. Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Acquiring lock "cinder-c8ea653f-fd51-4204-be21-91f21183edba-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Lock "cinder-c8ea653f-fd51-4204-be21-91f21183edba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Acquiring lock "cinder-quobyte-c8ea653f-fd51-4204-be21-91f21183edba" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Lock "cinder-quobyte-c8ea653f-fd51-4204-be21-91f21183edba" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e975e8d8-d265-46f2-b5f9-6b45e59c7d8e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:42 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba Sep 07 16:44:42 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:42 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba" returned: 0 in 0.608s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:42 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba Sep 07 16:44:42 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:43 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c8ea653f-fd51-4204-be21-91f21183edba" returned: 0 in 0.432s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Lock "cinder-quobyte-c8ea653f-fd51-4204-be21-91f21183edba" released by "delete_volume" :: held 1.119s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Acquiring lock "cinder-5b9cd708-32f3-46c6-8ab7-303c21219f7b-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-5b9cd708-32f3-46c6-8ab7-303c21219f7b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Acquiring lock "cinder-quobyte-5b9cd708-32f3-46c6-8ab7-303c21219f7b" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Created reservations ['84ae9103-d0c4-4c3a-88b2-2908e80845b4', 'a4bac61f-10dd-4500-aeaa-2591aa91c624', 'dd0ff68a-3f6a-4242-ac6b-63ffae859d80', 'f18e9649-6458-45ab-897e-39689420da8a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-quobyte-5b9cd708-32f3-46c6-8ab7-303c21219f7b" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1294f8b7-0bb1-455a-97ca-62101a89c058]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:43 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:43 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:43 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b Sep 07 16:44:43 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:43 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.301s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Deleted volume successfully. Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c4121009-b3ad-4606-a941-34275a90c8f5 tempest-TaggedAttachmentsTest-339607739 None] Lock "cinder-c8ea653f-fd51-4204-be21-91f21183edba-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:43 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b" returned: 0 in 0.622s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:44 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b Sep 07 16:44:44 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:44 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-e27ef758-3f5a-4fef-b6f6-27a3f0886a24 tempest-ServerActionsTestOtherA-695842632 None] Terminate volume connection completed successfully. Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-e27ef758-3f5a-4fef-b6f6-27a3f0886a24 tempest-ServerActionsTestOtherA-695842632 None] Deleting attachment 66ee24db-2cbb-4d07-a188-75ebaaad888e. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:44:44 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5b9cd708-32f3-46c6-8ab7-303c21219f7b" returned: 0 in 0.307s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-quobyte-5b9cd708-32f3-46c6-8ab7-303c21219f7b" released by "delete_volume" :: held 0.985s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Created reservations ['38129f64-767c-4a0f-92da-b97a807622ae', 'b6f8f705-c02c-4a87-b1b6-25577d433438', 'f53f943b-eed4-4e76-aa69-e4848daf9633', '45348383-ef79-486a-adcc-9b0132b7d0e8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "cinder-2dcf4763-fdd6-4624-b6e2-88c763995f00-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-2dcf4763-fdd6-4624-b6e2-88c763995f00-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "cinder-quobyte-2dcf4763-fdd6-4624-b6e2-88c763995f00" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-quobyte-2dcf4763-fdd6-4624-b6e2-88c763995f00" acquired by "delete_volume" :: waited 0.046s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:44 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:44 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6748fe-6439-44e7-902a-2b9b2e69fff6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:44 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.334s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:44 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Deleted volume successfully. Sep 07 16:44:44 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 Sep 07 16:44:44 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ef754a2a-b0f0-4830-9807-c6287d2902f2 tempest-VolumesTransfersTest-1247551486 None] Lock "cinder-5b9cd708-32f3-46c6-8ab7-303c21219f7b-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:45 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00" returned: 0 in 0.588s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:45 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00 Sep 07 16:44:45 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "cinder-347a739a-95f3-4901-8e14-ae3a31cbb30b-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-347a739a-95f3-4901-8e14-ae3a31cbb30b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:45 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2dcf4763-fdd6-4624-b6e2-88c763995f00" returned: 0 in 0.421s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "cinder-quobyte-347a739a-95f3-4901-8e14-ae3a31cbb30b" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-quobyte-2dcf4763-fdd6-4624-b6e2-88c763995f00" released by "delete_volume" :: held 1.078s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-quobyte-347a739a-95f3-4901-8e14-ae3a31cbb30b" acquired by "delete_volume" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ceebe7-b93a-46e3-a3af-8d8f40f0f3b9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG cinder.quota [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Created reservations ['5edb892d-e57b-4e12-8cf2-019655a5931e', '630e064b-0cd6-4921-a54f-fdc52ba50864', 'f21d3f97-b2bf-40da-a324-a9d724d7de0c', '36758237-bcb8-46f2-868a-1e643b03de5d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:45 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b Sep 07 16:44:45 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:46 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:46 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:46 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b" returned: 0 in 0.767s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:46 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b Sep 07 16:44:46 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:46 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.669s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG cinder.manager [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Deleted volume successfully. Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-e8bc1f48-873e-4fd0-a169-9f1ad1b51444 req-c1d153ec-f361-448a-b7b2-8f311f569e01 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-2dcf4763-fdd6-4624-b6e2-88c763995f00-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:46 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-347a739a-95f3-4901-8e14-ae3a31cbb30b" returned: 0 in 0.341s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-quobyte-347a739a-95f3-4901-8e14-ae3a31cbb30b" released by "delete_volume" :: held 1.172s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:46 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Created reservations ['fc193923-c65d-4ef3-a4bb-df692f4690c4', '8d7a5c29-f4e5-4a4a-8467-98c02adf594e', 'fba4a898-4185-4d14-9705-02a7ecd09c74', 'fd58a014-e3fb-44e9-9214-27999fd03064'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:44:47 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:44:47 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:44:47 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.381s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:44:47 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Deleted volume successfully. Sep 07 16:44:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7475b4b5-83b3-46eb-8aca-48a5305483e9 tempest-ServerActionsTestOtherA-695842632 None] Lock "cinder-347a739a-95f3-4901-8e14-ae3a31cbb30b-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:44:57 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=74,cinder:SELECT=61,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:44:57 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=81,cinder:INSERT=23,cinder:UPDATE=100,cinder:DELETE=10 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Flow 'volume_create_manager' (2f476d31-7bb4-4536-853a-865856360737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e843f0-72a1-4ef5-b462-3092af67f62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e843f0-72a1-4ef5-b462-3092af67f62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851601717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9462c5d-0f15-4034-84bc-80a17288f43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc8602e3d4849548f8aa9bc348a8dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:09Z,use_quota=True,user_id='12d33d503bf54c59a78ad9b465f4252c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346df6f9-0f2f-4076-97fe-0942ddbda5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346df6f9-0f2f-4076-97fe-0942ddbda5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4324a3-7a6a-4e02-bf2d-98a4c77be246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4324a3-7a6a-4e02-bf2d-98a4c77be246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9462c5d-0f15-4034-84bc-80a17288f43b', 'volume_name': 'volume-e9462c5d-0f15-4034-84bc-80a17288f43b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603b911e-49c2-48d0-b154-d7f4cef89159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603b911e-49c2-48d0-b154-d7f4cef89159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfd642c-5708-47c3-9081-cf4217c69255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:09 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Volume e9462c5d-0f15-4034-84bc-80a17288f43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9462c5d-0f15-4034-84bc-80a17288f43b', 'volume_size': 1} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851601717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9462c5d-0f15-4034-84bc-80a17288f43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcc8602e3d4849548f8aa9bc348a8dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:09Z,use_quota=True,user_id='12d33d503bf54c59a78ad9b465f4252c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Creating volume e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:45:09 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:09 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b 1073741824 Sep 07 16:45:09 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:09 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b 1073741824" returned: 0 in 0.544s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:09 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:45:09 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:10 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:45:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfd642c-5708-47c3-9081-cf4217c69255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9462c5d-0f15-4034-84bc-80a17288f43b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d179af69-c155-4cf4-b9ae-982b0255e41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:10 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Volume volume-e9462c5d-0f15-4034-84bc-80a17288f43b (e9462c5d-0f15-4034-84bc-80a17288f43b): created successfully Sep 07 16:45:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d179af69-c155-4cf4-b9ae-982b0255e41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Flow 'volume_create_manager' (2f476d31-7bb4-4536-853a-865856360737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1faba0f3-f9f0-48cf-b833-0f26fc2a59d8 tempest-VolumesActionsTest-130855833 None] Created volume successfully. Sep 07 16:45:20 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:45:20 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:45:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Acquiring lock "cinder-f9e089cc-0226-43cc-b8bc-320fc7db79a3-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:45:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "cinder-f9e089cc-0226-43cc-b8bc-320fc7db79a3-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:45:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Acquiring lock "cinder-quobyte-f9e089cc-0226-43cc-b8bc-320fc7db79a3" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:45:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "cinder-quobyte-f9e089cc-0226-43cc-b8bc-320fc7db79a3" acquired by "delete_volume" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:45:30 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ea343-aa78-4d6b-b473-7f4954b66162]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:45:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:30 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 Sep 07 16:45:30 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6da69af5-62ac-4cc1-819a-ed9db8718cfd tempest-VolumesActionsTest-130855833 None] Acquiring lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b" by "attach_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:45:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6da69af5-62ac-4cc1-819a-ed9db8718cfd tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b" acquired by "attach_volume" :: waited 0.077s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:45:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6da69af5-62ac-4cc1-819a-ed9db8718cfd tempest-VolumesActionsTest-130855833 None] Attaching volume e9462c5d-0f15-4034-84bc-80a17288f43b to instance a37e0add-93f6-45e5-92bd-ac252b7ebe70 at mountpoint /dev/vdb on host None. Sep 07 16:45:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6da69af5-62ac-4cc1-819a-ed9db8718cfd tempest-VolumesActionsTest-130855833 None] Attach volume completed successfully. Sep 07 16:45:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6da69af5-62ac-4cc1-819a-ed9db8718cfd tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b" released by "attach_volume" :: held 0.329s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:45:31 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3" returned: 0 in 1.244s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:31 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3 Sep 07 16:45:31 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0528aa3a-ed34-426a-8c14-cb9772afe3d6 tempest-VolumesActionsTest-130855833 None] Acquiring lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-detach_volume" by "detach_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:45:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0528aa3a-ed34-426a-8c14-cb9772afe3d6 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:45:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0528aa3a-ed34-426a-8c14-cb9772afe3d6 tempest-VolumesActionsTest-130855833 None] Detaching volume e9462c5d-0f15-4034-84bc-80a17288f43b from instance a37e0add-93f6-45e5-92bd-ac252b7ebe70. Sep 07 16:45:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0528aa3a-ed34-426a-8c14-cb9772afe3d6 tempest-VolumesActionsTest-130855833 None] Detach volume completed successfully. Sep 07 16:45:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0528aa3a-ed34-426a-8c14-cb9772afe3d6 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-detach_volume" released by "detach_volume" :: held 0.213s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:45:32 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9e089cc-0226-43cc-b8bc-320fc7db79a3" returned: 0 in 0.779s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "cinder-quobyte-f9e089cc-0226-43cc-b8bc-320fc7db79a3" released by "delete_volume" :: held 2.174s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Created reservations ['516221e4-b1bb-4dac-adca-6ebddffb8b91', 'acea9366-bf03-42c5-853d-e445be2e50ce', '87990965-26e8-48de-8a22-ffea638f7ab7', '2dc74777-3caf-4993-bc30-2e49683fd169'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:32 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:45:32 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:33 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.379s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:45:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Deleted volume successfully. Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c65dae45-dc60-4e31-accf-756c505cb81d tempest-AttachVolumeShelveTestJSON-861181006 None] Lock "cinder-f9e089cc-0226-43cc-b8bc-320fc7db79a3-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:33 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:45:33 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:33 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.342s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:45:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:45:42 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=14,cinder:SELECT=12,cinder:INSERT=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:45:43 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:45:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:45:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Flow 'volume_create_manager' (486c85d4-0f50-4947-8f85-6c7c38b60601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3efdac-11f8-4cfa-8aec-c4acabb40707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3efdac-11f8-4cfa-8aec-c4acabb40707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1300364238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfaa1ee-6f85-4cfe-b594-f599b003fa9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d057f71e2284e5caf7f584048f38ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:51Z,use_quota=True,user_id='401e7d9e54054c1583f78665963b2bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb45db2d-7be9-44a8-a543-8c5c4214663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb45db2d-7be9-44a8-a543-8c5c4214663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fd1d99-0384-47d4-adb3-6c31c08185ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fd1d99-0384-47d4-adb3-6c31c08185ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abfaa1ee-6f85-4cfe-b594-f599b003fa9f', 'volume_name': 'volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820fa76b-c532-4acd-96d1-277fd7ee2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820fa76b-c532-4acd-96d1-277fd7ee2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc6bab4-7ee1-42b8-9c73-f778cebe7299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:51 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Volume abfaa1ee-6f85-4cfe-b594-f599b003fa9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f', 'volume_size': 1} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1300364238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfaa1ee-6f85-4cfe-b594-f599b003fa9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d057f71e2284e5caf7f584048f38ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:51Z,use_quota=True,user_id='401e7d9e54054c1583f78665963b2bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Creating volume abfaa1ee-6f85-4cfe-b594-f599b003fa9f {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:45:51 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:51 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f 1073741824 Sep 07 16:45:51 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:51 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f 1073741824" returned: 0 in 0.783s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:51 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f Sep 07 16:45:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:51 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:52 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f" returned: 0 in 1.023s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:45:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc6bab4-7ee1-42b8-9c73-f778cebe7299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f28d14-dede-4b05-b84a-3a36d77123fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Volume volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f (abfaa1ee-6f85-4cfe-b594-f599b003fa9f): created successfully Sep 07 16:45:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f28d14-dede-4b05-b84a-3a36d77123fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Flow 'volume_create_manager' (486c85d4-0f50-4947-8f85-6c7c38b60601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-dcdeb146-659e-460a-a486-69126632c34f tempest-VolumesTestJSON-344098507 None] Created volume successfully. Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Flow 'volume_create_manager' (3ea28f30-a47e-492d-8750-1ce187f9362b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3424f1c9-8780-4901-9155-4778c228326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3424f1c9-8780-4901-9155-4778c228326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1489109756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184f568f-9a5e-430b-86f6-f6852bdef500,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d057f71e2284e5caf7f584048f38ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:55Z,use_quota=True,user_id='401e7d9e54054c1583f78665963b2bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4161b8ba-99c9-4daa-94cc-f8e31d947456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4161b8ba-99c9-4daa-94cc-f8e31d947456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2475d40c-4c33-43c8-83b1-8070f4f71a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2475d40c-4c33-43c8-83b1-8070f4f71a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184f568f-9a5e-430b-86f6-f6852bdef500', 'volume_name': 'volume-184f568f-9a5e-430b-86f6-f6852bdef500', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145353b6-3453-45c6-8675-19c996ad90c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145353b6-3453-45c6-8675-19c996ad90c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ee7e91-078a-49f9-a584-31c9509ee5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:55 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Volume 184f568f-9a5e-430b-86f6-f6852bdef500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184f568f-9a5e-430b-86f6-f6852bdef500', 'volume_size': 1} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1489109756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184f568f-9a5e-430b-86f6-f6852bdef500,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d057f71e2284e5caf7f584048f38ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:55Z,use_quota=True,user_id='401e7d9e54054c1583f78665963b2bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Creating volume 184f568f-9a5e-430b-86f6-f6852bdef500 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:45:55 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:55 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 1073741824 Sep 07 16:45:55 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4728913a-d3cb-4984-a06d-e007b5bbd0f8 tempest-VolumesActionsTest-130855833 None] Acquiring lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b" by "attach_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4728913a-d3cb-4984-a06d-e007b5bbd0f8 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b" acquired by "attach_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:45:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4728913a-d3cb-4984-a06d-e007b5bbd0f8 tempest-VolumesActionsTest-130855833 None] Attaching volume e9462c5d-0f15-4034-84bc-80a17288f43b to instance 187d92d3-cce9-4f13-923b-1c8b457a6b50 at mountpoint /dev/vdb on host None. Sep 07 16:45:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4728913a-d3cb-4984-a06d-e007b5bbd0f8 tempest-VolumesActionsTest-130855833 None] Attach volume completed successfully. Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4728913a-d3cb-4984-a06d-e007b5bbd0f8 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b" released by "attach_volume" :: held 0.120s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:45:55 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 1073741824" returned: 0 in 0.649s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:55 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 Sep 07 16:45:55 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:56 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500" returned: 0 in 0.322s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ee7e91-078a-49f9-a584-31c9509ee5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184f568f-9a5e-430b-86f6-f6852bdef500', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd93dc8-9948-41db-b1b2-cc3456eb1a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:56 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Volume volume-184f568f-9a5e-430b-86f6-f6852bdef500 (184f568f-9a5e-430b-86f6-f6852bdef500): created successfully Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd93dc8-9948-41db-b1b2-cc3456eb1a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Flow 'volume_create_manager' (3ea28f30-a47e-492d-8750-1ce187f9362b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-67eacc41-60c9-44eb-97b9-a4663ee73ee4 tempest-VolumesActionsTest-130855833 None] Acquiring lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-detach_volume" by "detach_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:45:56 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-17c49d9d-37d4-4ba9-a521-26e021ad8d8f tempest-VolumesTestJSON-344098507 None] Created volume successfully. Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-67eacc41-60c9-44eb-97b9-a4663ee73ee4 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:45:56 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-67eacc41-60c9-44eb-97b9-a4663ee73ee4 tempest-VolumesActionsTest-130855833 None] Detaching volume e9462c5d-0f15-4034-84bc-80a17288f43b from instance 187d92d3-cce9-4f13-923b-1c8b457a6b50. Sep 07 16:45:56 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-67eacc41-60c9-44eb-97b9-a4663ee73ee4 tempest-VolumesActionsTest-130855833 None] Detach volume completed successfully. Sep 07 16:45:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-67eacc41-60c9-44eb-97b9-a4663ee73ee4 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Flow 'volume_create_manager' (a6688cec-39d7-430c-b364-20505f27a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa74a485-42cb-471c-a200-55a51aedc928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa74a485-42cb-471c-a200-55a51aedc928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-971863940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27934a4b-ab46-4477-bf28-973e78cc2b77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d057f71e2284e5caf7f584048f38ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:58Z,use_quota=True,user_id='401e7d9e54054c1583f78665963b2bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f425456-5558-42f9-b797-ccf40220df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f425456-5558-42f9-b797-ccf40220df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7492eecf-dc54-4271-a536-69ef62440f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7492eecf-dc54-4271-a536-69ef62440f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27934a4b-ab46-4477-bf28-973e78cc2b77', 'volume_name': 'volume-27934a4b-ab46-4477-bf28-973e78cc2b77', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0432572e-8f92-458e-a95e-f797e4843419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0432572e-8f92-458e-a95e-f797e4843419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58629ed-2eab-43bc-b01b-5c176d6ecf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:57 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Volume 27934a4b-ab46-4477-bf28-973e78cc2b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27934a4b-ab46-4477-bf28-973e78cc2b77', 'volume_size': 1} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-971863940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27934a4b-ab46-4477-bf28-973e78cc2b77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9d057f71e2284e5caf7f584048f38ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:45:58Z,use_quota=True,user_id='401e7d9e54054c1583f78665963b2bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Creating volume 27934a4b-ab46-4477-bf28-973e78cc2b77 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:45:57 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:45:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:57 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 1073741824 Sep 07 16:45:57 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:58 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 1073741824" returned: 0 in 0.533s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:45:58 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 Sep 07 16:45:58 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:45:58 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77" returned: 0 in 0.265s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58629ed-2eab-43bc-b01b-5c176d6ecf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27934a4b-ab46-4477-bf28-973e78cc2b77', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d741f74-a13b-4398-a02e-f01f03d6d2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:45:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Volume volume-27934a4b-ab46-4477-bf28-973e78cc2b77 (27934a4b-ab46-4477-bf28-973e78cc2b77): created successfully Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d741f74-a13b-4398-a02e-f01f03d6d2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:45:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Flow 'volume_create_manager' (a6688cec-39d7-430c-b364-20505f27a397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:45:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6d66f81c-7f36-471e-8bd5-c23a9377ad38 tempest-VolumesTestJSON-344098507 None] Created volume successfully. Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Acquiring lock "cinder-27934a4b-ab46-4477-bf28-973e78cc2b77-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Lock "cinder-27934a4b-ab46-4477-bf28-973e78cc2b77-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Acquiring lock "cinder-quobyte-27934a4b-ab46-4477-bf28-973e78cc2b77" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Lock "cinder-quobyte-27934a4b-ab46-4477-bf28-973e78cc2b77" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae52f2-ad36-4190-a4a1-39ba3f2d0490]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ce19c-ca0c-4b95-a0b7-9b0483277c46]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:00 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 Sep 07 16:46:00 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:00 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:00 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:01 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77" returned: 0 in 0.388s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:01 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77 Sep 07 16:46:01 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:01 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.364s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef38c4-649b-4fa4-b256-125f0bb8bffe]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:01 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:01 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:01 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-27934a4b-ab46-4477-bf28-973e78cc2b77" returned: 0 in 0.250s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Lock "cinder-quobyte-27934a4b-ab46-4477-bf28-973e78cc2b77" released by "delete_volume" :: held 0.706s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Created reservations ['e9759204-337e-404d-a678-e12c4f3fa470', 'a01ea966-d3f8-4064-8885-49838bd59a33', '1c006af0-6263-485a-9994-04d3ad0a2c08', '4e39b9cf-a479-43d6-8cbe-4763ad98c830'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:01 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:46:01 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:01 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.362s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.96f85385-9358-4f72-9889-af892728de4d9fke6jo_.img {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:01 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.96f85385-9358-4f72-9889-af892728de4d9fke6jo_.img Sep 07 16:46:01 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:01 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Acquiring lock "cinder-184f568f-9a5e-430b-86f6-f6852bdef500-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.280s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:46:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Deleted volume successfully. Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Lock "cinder-184f568f-9a5e-430b-86f6-f6852bdef500-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aacd0486-52d9-4045-9286-3116e71e785d tempest-VolumesTestJSON-344098507 None] Lock "cinder-27934a4b-ab46-4477-bf28-973e78cc2b77-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Acquiring lock "cinder-quobyte-184f568f-9a5e-430b-86f6-f6852bdef500" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Lock "cinder-quobyte-184f568f-9a5e-430b-86f6-f6852bdef500" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1158fbd2-c37e-4fae-82ed-c8192248f6bb]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:02 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 Sep 07 16:46:02 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:02 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500" returned: 0 in 0.924s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:02 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500 Sep 07 16:46:02 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:03 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-184f568f-9a5e-430b-86f6-f6852bdef500" returned: 0 in 1.126s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Lock "cinder-quobyte-184f568f-9a5e-430b-86f6-f6852bdef500" released by "delete_volume" :: held 2.207s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Created reservations ['35e6836e-8e97-44e1-a53b-a191eb47ea78', '5e91fc8c-53a1-45b7-9324-1aed5595b9fd', '26933cd6-6682-41f8-a88b-1cf4c3e19f03', 'be07deae-dd0d-4bc7-9566-4756bb69eedb'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:04 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:46:04 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:05 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.847s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:46:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Deleted volume successfully. Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Acquiring lock "cinder-abfaa1ee-6f85-4cfe-b594-f599b003fa9f-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eecd1784-e306-4871-922f-cf4ce7ef7a6c tempest-VolumesTestJSON-344098507 None] Lock "cinder-184f568f-9a5e-430b-86f6-f6852bdef500-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Lock "cinder-abfaa1ee-6f85-4cfe-b594-f599b003fa9f-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Acquiring lock "cinder-quobyte-abfaa1ee-6f85-4cfe-b594-f599b003fa9f" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Lock "cinder-quobyte-abfaa1ee-6f85-4cfe-b594-f599b003fa9f" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1851d9-0d9f-4d72-ba2f-3f3ce1cd6176]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:06 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f Sep 07 16:46:06 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:06 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f" returned: 0 in 0.828s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:06 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f Sep 07 16:46:06 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Flow 'volume_create_manager' (5982c314-b09f-4566-a05c-3e7c4d484adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfd9336-1bf5-40c5-a4df-4e3ed72e44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfd9336-1bf5-40c5-a4df-4e3ed72e44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039183510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40dfdc598e245cd888bc29dd01f7b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:07Z,use_quota=True,user_id='0ab5bf2fcafc4823911ac04c5d8a605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02fcbfa-5803-4e45-91c1-210a561d16f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02fcbfa-5803-4e45-91c1-210a561d16f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74807849-0271-4bac-be74-0f7b806e2d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74807849-0271-4bac-be74-0f7b806e2d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143', 'volume_name': 'volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:07 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662ba15a-3318-4ed8-88db-f79cd71c8b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662ba15a-3318-4ed8-88db-f79cd71c8b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfe5029-6295-4550-baa6-0a40c1ff6f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:07 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Volume 2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143', 'volume_size': 1} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abfaa1ee-6f85-4cfe-b594-f599b003fa9f" returned: 0 in 0.919s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Lock "cinder-quobyte-abfaa1ee-6f85-4cfe-b594-f599b003fa9f" released by "delete_volume" :: held 1.869s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:07 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Created reservations ['7213661e-4b2a-489a-a6c9-f7507aedcbb8', '23b2c2ae-defd-44fa-b0b8-9ada0c72ab65', '783b6b18-2e07-424e-ae71-663a4bce305e', 'cf27b93f-4e0a-4eab-bed3-8c31f7f88497'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:08 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:46:08 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:08 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.96f85385-9358-4f72-9889-af892728de4d9fke6jo_.img" returned: 0 in 6.668s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33d3bdd-ec3b-41aa-b329-c11843f0da83]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Flow 'volume_create_manager' (149f94c1-41b6-4a8b-9c3f-e55a5d79f272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28ea5a2-2a6f-4ea3-9759-cb782b7c1cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28ea5a2-2a6f-4ea3-9759-cb782b7c1cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1846512833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbea8860-53f3-42dd-adf6-fa4f6f299f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43ff57b14654fe5a5fa7f2dc7982c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:08Z,use_quota=True,user_id='aad9c52666fc434896e6f30cab7400da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34992e4-5c08-4d3b-921f-1527790e3ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:08 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:08 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34992e4-5c08-4d3b-921f-1527790e3ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06baf19-3697-4a3d-b500-206adbdb09fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06baf19-3697-4a3d-b500-206adbdb09fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbea8860-53f3-42dd-adf6-fa4f6f299f6a', 'volume_name': 'volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f45283-9206-4fd8-9b98-397af89ae730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f45283-9206-4fd8-9b98-397af89ae730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c981943-5a2d-4fea-bc7d-3760878c941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:08 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Volume bbea8860-53f3-42dd-adf6-fa4f6f299f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a', 'volume_size': 1} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:08 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.308s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:46:08 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Deleted volume successfully. Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4d59f358-8797-455e-8dd4-511e06fc4efc tempest-VolumesTestJSON-344098507 None] Lock "cinder-abfaa1ee-6f85-4cfe-b594-f599b003fa9f-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:08 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.589s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.96f85385-9358-4f72-9889-af892728de4d9fke6jo_.img {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:46:08 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Converted 1024.00 MB image at 153.54 MB/s Sep 07 16:46:08 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] 96f85385-9358-4f72-9889-af892728de4d was raw, no need to convert to raw {{(pid=87492) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 16:46:18 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=33,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:46:18 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=30,cinder:UPDATE=35,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:46:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3d858bd6-0660-4a98-8716-f7120e06391e tempest-GroupsV314Test-1527352611 None] Group tempest-GroupsV314Test-Group-1085147413: creating Sep 07 16:46:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3d858bd6-0660-4a98-8716-f7120e06391e tempest-GroupsV314Test-1527352611 None] Group tempest-GroupsV314Test-Group-1085147413: created successfully Sep 07 16:46:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3d858bd6-0660-4a98-8716-f7120e06391e tempest-GroupsV314Test-1527352611 None] Create group completed successfully. Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Flow 'volume_create_manager' (6a883066-ebee-448f-bb69-8e89031805a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0264d037-c636-4286-8ca6-5b470b706f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0264d037-c636-4286-8ca6-5b470b706f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1983770244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d062c52-dda1-40a7-96d2-a0fbc42211ba,host='devstack@QuobyteHD#QuobyteHD',id=b5566832-bf7b-4b07-8d5c-e8209f14bdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ea7f427d548f39b270a3c1c32ada6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:27Z,use_quota=True,user_id='629483601ae1459da2f07e656f7f2b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a615607-f1db-4ab0-b868-bebae4a1eb20),volume_type_id=9a615607-f1db-4ab0-b868-bebae4a1eb20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542fff23-4674-431e-a792-b3b25a3b8eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542fff23-4674-431e-a792-b3b25a3b8eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35719be6-b70e-419f-910f-75015836e8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35719be6-b70e-419f-910f-75015836e8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5566832-bf7b-4b07-8d5c-e8209f14bdf9', 'volume_name': 'volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88eb63d9-a4ec-4620-b021-4eb77478acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88eb63d9-a4ec-4620-b021-4eb77478acf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a3db0c-d4ad-4ee4-bba8-ae798946b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:27 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Volume b5566832-bf7b-4b07-8d5c-e8209f14bdf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9', 'volume_size': 1} Sep 07 16:46:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.183s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Uploaded volume to glance image-id: 96f85385-9358-4f72-9889-af892728de4d. {{(pid=87492) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.265s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2039183510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40dfdc598e245cd888bc29dd01f7b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:07Z,use_quota=True,user_id='0ab5bf2fcafc4823911ac04c5d8a605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Creating volume 2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:46:28 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:46:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-29c06f03-2738-4be2-870f-02227881099b tempest-VolumesActionsTest-130855833 None] Copy volume to image completed successfully. Sep 07 16:46:28 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 1073741824 Sep 07 16:46:28 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:29 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 1073741824" returned: 0 in 0.484s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:29 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 Sep 07 16:46:29 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:29 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.372s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1846512833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbea8860-53f3-42dd-adf6-fa4f6f299f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43ff57b14654fe5a5fa7f2dc7982c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:08Z,use_quota=True,user_id='aad9c52666fc434896e6f30cab7400da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Creating volume bbea8860-53f3-42dd-adf6-fa4f6f299f6a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:46:29 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfe5029-6295-4550-baa6-0a40c1ff6f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:29 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a 1073741824 Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437dbca7-76fb-40ec-8e86-6bbae9dddee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:29 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Volume volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 (2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143): created successfully Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437dbca7-76fb-40ec-8e86-6bbae9dddee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Flow 'volume_create_manager' (5982c314-b09f-4566-a05c-3e7c4d484adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-034ff86c-041f-4d9c-95fd-2f664f86fe41 tempest-AttachVolumeTestJSON-1159535621 None] Created volume successfully. Sep 07 16:46:30 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a 1073741824" returned: 0 in 0.530s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:30 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a Sep 07 16:46:30 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:30 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a" returned: 0 in 0.310s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.476s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7d062c52-dda1-40a7-96d2-a0fbc42211ba,created_at=2026-09-07T14:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1983770244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7d062c52-dda1-40a7-96d2-a0fbc42211ba,host='devstack@QuobyteHD#QuobyteHD',id=b5566832-bf7b-4b07-8d5c-e8209f14bdf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90ea7f427d548f39b270a3c1c32ada6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:27Z,use_quota=True,user_id='629483601ae1459da2f07e656f7f2b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a615607-f1db-4ab0-b868-bebae4a1eb20),volume_type_id=9a615607-f1db-4ab0-b868-bebae4a1eb20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Creating volume b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:46:30 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c981943-5a2d-4fea-bc7d-3760878c941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a27287d-9db5-4817-8fbe-3274a2e13fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:30 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 1073741824 Sep 07 16:46:30 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:30 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Volume volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a (bbea8860-53f3-42dd-adf6-fa4f6f299f6a): created successfully Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a27287d-9db5-4817-8fbe-3274a2e13fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Flow 'volume_create_manager' (149f94c1-41b6-4a8b-9c3f-e55a5d79f272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:30 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f1f9b021-249d-4abe-837d-b8ae466bfecd tempest-AttachVolumeNegativeTest-310406525 None] Created volume successfully. Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-f6b3bfcc-4726-42af-8a34-36152ac69190 req-a80db25e-eae9-4ec4-a7a2-c7c6be056429 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:31 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 1073741824" returned: 0 in 0.489s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:31 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 Sep 07 16:46:31 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:31 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.608s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a3db0c-d4ad-4ee4-bba8-ae798946b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e3869f-4433-40d3-b4d6-dc7f9b2616a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b2b100-b205-47e4-8972-8453a405d61c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:31 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Volume volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 (b5566832-bf7b-4b07-8d5c-e8209f14bdf9): created successfully Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e3869f-4433-40d3-b4d6-dc7f9b2616a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Flow 'volume_create_manager' (6a883066-ebee-448f-bb69-8e89031805a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-24ffa30a-728f-4827-abba-a54bc508b110 tempest-GroupsV314Test-1527352611 None] Created volume successfully. Sep 07 16:46:31 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:31 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:31 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.371s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac66589e-1924-47d1-bd8c-c38992895fa0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:31 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:31 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:32 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.379s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:32 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img Sep 07 16:46:32 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:46:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:33 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:46:33 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:34 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.643s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:34 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:46:34 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:46:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:46:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:46:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-07fcb50c-3719-49c2-9c57-3fec921f7125 req-396b4a6d-15e4-497c-b46c-e22efe381b69 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:36 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img" returned: 0 in 4.412s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:36 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58b7757-667d-4124-9012-d86ca40e0c37]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:36 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:36 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:37 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.486s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:46:37 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Converted 1024.00 MB image at 232.06 MB/s Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] 7cc04dfe-06e5-431b-af06-dde18c0aa8d6 was raw, converting to qcow2 {{(pid=87492) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[50939d8c-35d6-427d-b637-6cc932b41cb4]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:37 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img Sep 07 16:46:37 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:37 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img" returned: 0 in 0.315s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:37 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img Sep 07 16:46:37 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:37 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img" returned: 1 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img /opt/stack/data/cinder/conversion/vol_upload_q9xvxsb8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:37 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img /opt/stack/data/cinder/conversion/vol_upload_q9xvxsb8 Sep 07 16:46:37 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:37 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img /opt/stack/data/cinder/conversion/vol_upload_q9xvxsb8" returned: 0 in 0.252s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Image conversion details: src /opt/stack/data/cinder/conversion/e9462c5d-0f15-4034-84bc-80a17288f43b.temp_image.7cc04dfe-06e5-431b-af06-dde18c0aa8d6d2y8kw8i.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_q9xvxsb8 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:46:37 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7421e7e1-abf2-4786-ab56-9d822bc92c47]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q9xvxsb8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:38 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q9xvxsb8 Sep 07 16:46:38 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:38 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q9xvxsb8" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.152s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Uploaded volume to glance image-id: 7cc04dfe-06e5-431b-af06-dde18c0aa8d6. {{(pid=87492) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-f6b3bfcc-4726-42af-8a34-36152ac69190 req-a80db25e-eae9-4ec4-a7a2-c7c6be056429 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.706s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-f6b3bfcc-4726-42af-8a34-36152ac69190 req-a80db25e-eae9-4ec4-a7a2-c7c6be056429 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.947s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:39 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Cloning volume b5566832-bf7b-4b07-8d5c-e8209f14bdf9 to volume 812fb008-6d1b-4b6e-bf6b-7293ff471625 Sep 07 16:46:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-772908ba-2e54-40a1-b027-791103e40af1 tempest-VolumesActionsTest-130855833 None] Copy volume to image completed successfully. Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-f6b3bfcc-4726-42af-8a34-36152ac69190 req-a80db25e-eae9-4ec4-a7a2-c7c6be056429 tempest-AttachVolumeTestJSON-1159535621 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac5298c5-8462-49fd-b49d-5ac374bbc4aa', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Creating offline snapshot 5fb0002f-41a8-4aae-9cc9-712016c701b1 of volume b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bbf7eb-7a1c-47e5-b9a1-33ddf58b62e8]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-f6b3bfcc-4726-42af-8a34-36152ac69190 req-a80db25e-eae9-4ec4-a7a2-c7c6be056429 tempest-AttachVolumeTestJSON-1159535621 None] attachment_update completed successfully. Sep 07 16:46:39 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 Sep 07 16:46:39 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:40 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" returned: 0 in 0.421s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:40 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 1G Sep 07 16:46:40 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:40 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 1G" returned: 0 in 0.496s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:40 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 Sep 07 16:46:40 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:40 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1" returned: 0 in 0.317s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:40 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:46:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:40 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 Sep 07 16:46:40 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Acquiring lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Acquiring lock "cinder-quobyte-e9462c5d-0f15-4034-84bc-80a17288f43b" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Lock "cinder-quobyte-e9462c5d-0f15-4034-84bc-80a17288f43b" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:41 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1" returned: 0 in 0.265s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d327148-269e-440a-b4a2-5257dd04f960]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:41 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.info Sep 07 16:46:41 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:41 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:41 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:41 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.info" returned: 0 in 0.376s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:41 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:41 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.info Sep 07 16:46:41 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:41 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.455s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:41 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b Sep 07 16:46:41 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:41 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.info" returned: 0 in 0.278s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Acquiring lock "cinder-quobyte-812fb008-6d1b-4b6e-bf6b-7293ff471625" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:41 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-812fb008-6d1b-4b6e-bf6b-7293ff471625" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] snapshot: 5fb0002f-41a8-4aae-9cc9-712016c701b1, volume: 812fb008-6d1b-4b6e-bf6b-7293ff471625, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e9462c5d-0f15-4034-84bc-80a17288f43b" returned: 0 in 0.305s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Lock "cinder-quobyte-e9462c5d-0f15-4034-84bc-80a17288f43b" released by "delete_volume" :: held 0.813s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b954bf1-2bac-4044-8a15-f72188d7d583]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Created reservations ['9d0ead0a-c48b-489e-a879-95fcb8836c1d', '6b4a7677-57b7-4ab5-8b05-8e0854c819a7', '717f1647-045b-45fb-b6eb-154d7abbc7bb', '2a6707f1-c2b5-4a0a-ad88-0e83ccb78f02'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:42 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:42 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:42 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:46:42 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:42 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:46:42 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Deleted volume successfully. Sep 07 16:46:42 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1" returned: 0 in 0.392s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bd202d-2415-4699-a704-64f09d1ce9fe]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5f45ee0-f40b-4fc6-a957-e88373c29891 tempest-VolumesActionsTest-130855833 None] Lock "cinder-e9462c5d-0f15-4034-84bc-80a17288f43b-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:42 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 Sep 07 16:46:42 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:42 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" returned: 0 in 0.416s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:46:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:42 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 Sep 07 16:46:42 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:49 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625" returned: 0 in 6.779s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:49 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:46:49 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Converted 1024.00 MB image at 151.02 MB/s Sep 07 16:46:49 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:46:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:49 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 Sep 07 16:46:49 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:49 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-812fb008-6d1b-4b6e-bf6b-7293ff471625" released by "_copy_volume_from_snapshot" :: held 8.040s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Acquiring lock "cinder-quobyte-5fb0002f-41a8-4aae-9cc9-712016c701b1" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-5fb0002f-41a8-4aae-9cc9-712016c701b1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Deleting offline snapshot 5fb0002f-41a8-4aae-9cc9-712016c701b1 of volume b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] snapshot_file for this snap is: volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5f01ae-ee4d-4bf3-adf8-7fc003b4d5cd]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:50 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 Sep 07 16:46:50 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:50 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1" returned: 0 in 0.443s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f755db0-711f-45d4-b06b-46da4f4e9a0e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:50 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 Sep 07 16:46:50 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:51 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" returned: 0 in 0.732s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:51 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 Sep 07 16:46:51 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:51 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1" returned: 0 in 0.471s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:51 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1 Sep 07 16:46:51 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:52 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9.5fb0002f-41a8-4aae-9cc9-712016c701b1" returned: 0 in 0.306s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-5fb0002f-41a8-4aae-9cc9-712016c701b1" released by "_delete_snapshot" :: held 2.145s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.644s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-07fcb50c-3719-49c2-9c57-3fec921f7125 req-396b4a6d-15e4-497c-b46c-e22efe381b69 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.758s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-07fcb50c-3719-49c2-9c57-3fec921f7125 req-396b4a6d-15e4-497c-b46c-e22efe381b69 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-07fcb50c-3719-49c2-9c57-3fec921f7125 req-396b4a6d-15e4-497c-b46c-e22efe381b69 tempest-AttachVolumeNegativeTest-310406525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '570981c0-41e0-4771-9161-14bba1f1867e', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:46:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-adce23bd-4b16-4f76-ab73-c488d4a4ec00 tempest-GroupsV314Test-1527352611 None] Create group from source-group-7d062c52-dda1-40a7-96d2-a0fbc42211ba completed successfully. Sep 07 16:46:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-07fcb50c-3719-49c2-9c57-3fec921f7125 req-396b4a6d-15e4-497c-b46c-e22efe381b69 tempest-AttachVolumeNegativeTest-310406525 None] attachment_update completed successfully. Sep 07 16:46:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Acquiring lock "cinder-quobyte-812fb008-6d1b-4b6e-bf6b-7293ff471625" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-812fb008-6d1b-4b6e-bf6b-7293ff471625" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3417b43-7e8b-4d4d-b260-387f0227a65d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:53 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 Sep 07 16:46:53 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:54 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625" returned: 0 in 0.632s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:54 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625 Sep 07 16:46:54 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:54 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-812fb008-6d1b-4b6e-bf6b-7293ff471625" returned: 0 in 0.496s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-812fb008-6d1b-4b6e-bf6b-7293ff471625" released by "delete_volume" :: held 1.245s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:54 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Created reservations ['0a2b3e33-3398-42b0-a878-63de2c88455b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:54 devstack cinder-volume[87492]: WARNING cinder.quota [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-491029591 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-491029591, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:46:54 devstack cinder-volume[87492]: WARNING cinder.quota [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-491029591 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-491029591, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:46:54 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Created reservations ['f8e9fa5f-2f7a-4c1a-a057-dae43d578b77', '980cba33-bfeb-4663-922c-301d8750d0c8', 'ce81bf8b-acbb-4018-8c9f-82c2baf2b6ee', '780b4e51-ad13-4c90-91ee-33f52333f35e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:55 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:46:55 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:55 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.357s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:55 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:46:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-53563b38-29e3-427d-9abf-951e732290a6 tempest-GroupsV314Test-1527352611 None] Delete group completed successfully. Sep 07 16:46:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Acquiring lock "cinder-quobyte-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:46:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:46:56 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecd2761-d9a0-49cf-824d-dc6cdba8db82]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:46:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:56 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 Sep 07 16:46:56 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:56 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" returned: 0 in 0.594s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:57 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9 Sep 07 16:46:57 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Flow 'volume_create_manager' (6ba03a51-8fca-4d20-b6f0-b6996e1ab567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c89e556-7a37-4a5c-8b59-808116346a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c89e556-7a37-4a5c-8b59-808116346a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988365277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ff1cf4-8e81-42ef-8324-330473276605,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='346296a9cd1b4e6794a1fab11e4f4553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:57Z,use_quota=True,user_id='d7f49511dad547ccaebee1294df57a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30555a8-d999-4b28-94b5-a3859f2dc47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30555a8-d999-4b28-94b5-a3859f2dc47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ac1613-6108-421f-baeb-4eabb1f005f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ac1613-6108-421f-baeb-4eabb1f005f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ff1cf4-8e81-42ef-8324-330473276605', 'volume_name': 'volume-46ff1cf4-8e81-42ef-8324-330473276605', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ba9a21-f526-4220-9e5d-942a387e3ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ba9a21-f526-4220-9e5d-942a387e3ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfb6e6a-c27f-4f49-badb-1f725d202eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:57 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Volume 46ff1cf4-8e81-42ef-8324-330473276605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ff1cf4-8e81-42ef-8324-330473276605', 'volume_size': 1} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-988365277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ff1cf4-8e81-42ef-8324-330473276605,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='346296a9cd1b4e6794a1fab11e4f4553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:46:57Z,use_quota=True,user_id='d7f49511dad547ccaebee1294df57a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Creating volume 46ff1cf4-8e81-42ef-8324-330473276605 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:46:57 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:57 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 1073741824 Sep 07 16:46:57 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:57 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" returned: 0 in 0.297s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Lock "cinder-quobyte-b5566832-bf7b-4b07-8d5c-e8209f14bdf9" released by "delete_volume" :: held 1.047s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Created reservations ['7cdbc29d-bf04-4f08-9777-6eaaf8ca150a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Created reservations ['78dc1afc-a462-4fef-a49f-121e2d3fa50f', 'da35c394-fef9-4b5b-aae7-d7ddff676fb6', '8b5b33c8-0e51-42fb-80da-718a4fc8f8f6', '5c412ed7-0c52-4dd4-b75c-8398edc77adc'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:57 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:46:57 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:57 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 1073741824" returned: 0 in 0.620s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:46:57 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 Sep 07 16:46:57 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:46:57 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.342s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:57 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:46:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2d57b68a-11fe-4b7b-8e93-785abf3749b8 tempest-GroupsV314Test-1527352611 None] Delete group completed successfully. Sep 07 16:46:58 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 07 16:46:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605" returned: 0 in 0.333s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:46:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:46:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:46:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfb6e6a-c27f-4f49-badb-1f725d202eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ff1cf4-8e81-42ef-8324-330473276605', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6639220e-d4f7-459c-a93a-327692b3e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:46:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Volume volume-46ff1cf4-8e81-42ef-8324-330473276605 (46ff1cf4-8e81-42ef-8324-330473276605): created successfully Sep 07 16:46:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6639220e-d4f7-459c-a93a-327692b3e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:46:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Flow 'volume_create_manager' (6ba03a51-8fca-4d20-b6f0-b6996e1ab567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5e6d6874-bf1d-49d2-b158-c0b317d109aa tempest-VolumesListTestJSON-990244954 None] Created volume successfully. Sep 07 16:46:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:46:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Flow 'volume_create_manager' (f5957b78-b09d-4872-8215-21a9ee9bd53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:46:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5007bc7e-a349-4a33-b48e-a1b1ca082533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5007bc7e-a349-4a33-b48e-a1b1ca082533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-766841593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fc48c1-1637-4ef7-ad80-20778a4c7ea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='346296a9cd1b4e6794a1fab11e4f4553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:00Z,use_quota=True,user_id='d7f49511dad547ccaebee1294df57a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239c6414-e548-4c32-b1dd-2b29ce78e734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239c6414-e548-4c32-b1dd-2b29ce78e734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3175237c-86e8-455a-903e-4149a56a1d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3175237c-86e8-455a-903e-4149a56a1d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fc48c1-1637-4ef7-ad80-20778a4c7ea2', 'volume_name': 'volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf53c45-8b06-41ba-b664-b33b65cb9155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf53c45-8b06-41ba-b664-b33b65cb9155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d648e5ec-4910-4645-851c-43f67db6a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:00 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Volume 89fc48c1-1637-4ef7-ad80-20778a4c7ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2', 'volume_size': 1} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-766841593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fc48c1-1637-4ef7-ad80-20778a4c7ea2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='346296a9cd1b4e6794a1fab11e4f4553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:00Z,use_quota=True,user_id='d7f49511dad547ccaebee1294df57a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Creating volume 89fc48c1-1637-4ef7-ad80-20778a4c7ea2 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:47:00 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:00 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 1073741824 Sep 07 16:47:00 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:00 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 1073741824" returned: 0 in 0.687s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:00 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 Sep 07 16:47:00 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:01 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2" returned: 0 in 0.620s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:47:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d648e5ec-4910-4645-851c-43f67db6a109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fb8109-c639-4b46-a2c3-b0f3aadea772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:01 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Volume volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 (89fc48c1-1637-4ef7-ad80-20778a4c7ea2): created successfully Sep 07 16:47:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fb8109-c639-4b46-a2c3-b0f3aadea772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Flow 'volume_create_manager' (f5957b78-b09d-4872-8215-21a9ee9bd53b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f3d6c1e3-9a67-404d-adc6-f8ce6c805ccb tempest-VolumesListTestJSON-990244954 None] Created volume successfully. Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Flow 'volume_create_manager' (a9d69877-fd32-4331-9b16-6c6154c9162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4824e4-bf5f-4544-b211-9f4139074619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4824e4-bf5f-4544-b211-9f4139074619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1943242767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d076bc18-fda2-41f1-8105-0a9751e2e628,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='346296a9cd1b4e6794a1fab11e4f4553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:03Z,use_quota=True,user_id='d7f49511dad547ccaebee1294df57a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d973bb12-b1da-4b70-a6a4-248f05f3494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d973bb12-b1da-4b70-a6a4-248f05f3494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218848d5-ad67-4df5-9bc0-9f0b1eea4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218848d5-ad67-4df5-9bc0-9f0b1eea4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd076bc18-fda2-41f1-8105-0a9751e2e628', 'volume_name': 'volume-d076bc18-fda2-41f1-8105-0a9751e2e628', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a412f9-ab35-4bc2-9be8-ea581c575205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a412f9-ab35-4bc2-9be8-ea581c575205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c17dbe-bd84-49a1-84ab-7e35c6c04374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Volume d076bc18-fda2-41f1-8105-0a9751e2e628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d076bc18-fda2-41f1-8105-0a9751e2e628', 'volume_size': 1} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1943242767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d076bc18-fda2-41f1-8105-0a9751e2e628,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='346296a9cd1b4e6794a1fab11e4f4553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:03Z,use_quota=True,user_id='d7f49511dad547ccaebee1294df57a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Creating volume d076bc18-fda2-41f1-8105-0a9751e2e628 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:47:03 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:47:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:03 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 1073741824 Sep 07 16:47:03 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:03 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 1073741824" returned: 0 in 0.702s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:04 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 Sep 07 16:47:04 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:04 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628" returned: 0 in 0.323s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c17dbe-bd84-49a1-84ab-7e35c6c04374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d076bc18-fda2-41f1-8105-0a9751e2e628', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50fbd34-85f3-42fb-9d08-e0945ecbfbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Volume volume-d076bc18-fda2-41f1-8105-0a9751e2e628 (d076bc18-fda2-41f1-8105-0a9751e2e628): created successfully Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50fbd34-85f3-42fb-9d08-e0945ecbfbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Flow 'volume_create_manager' (a9d69877-fd32-4331-9b16-6c6154c9162b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5f741032-de05-4cfd-beae-40228d041a3d tempest-VolumesListTestJSON-990244954 None] Created volume successfully. Sep 07 16:47:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Acquiring lock "cinder-d076bc18-fda2-41f1-8105-0a9751e2e628-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-d076bc18-fda2-41f1-8105-0a9751e2e628-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Acquiring lock "cinder-quobyte-d076bc18-fda2-41f1-8105-0a9751e2e628" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-quobyte-d076bc18-fda2-41f1-8105-0a9751e2e628" acquired by "delete_volume" :: waited 0.056s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f5ee2-b924-4bb9-948a-ebcc1faa72b4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:47:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:08 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 Sep 07 16:47:08 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:09 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628" returned: 0 in 0.686s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:09 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628 Sep 07 16:47:09 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:09 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d076bc18-fda2-41f1-8105-0a9751e2e628" returned: 0 in 0.386s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-quobyte-d076bc18-fda2-41f1-8105-0a9751e2e628" released by "delete_volume" :: held 1.132s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Created reservations ['c857a4f6-93ae-4e95-80d4-51fed8d44753', 'ed0cafd2-7c28-423e-b6f6-1c3bdc6ba04b', '1a6f28e9-0cae-4fd6-bcc1-779a83180d6f', 'd4d09606-cf2e-4ec1-a6b3-a4d2810ac42f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:09 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:09 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:10 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.313s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Deleted volume successfully. Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-af738521-b414-4b03-8f8f-21aa15d751f2 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-d076bc18-fda2-41f1-8105-0a9751e2e628-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Acquiring lock "cinder-89fc48c1-1637-4ef7-ad80-20778a4c7ea2-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Lock "cinder-89fc48c1-1637-4ef7-ad80-20778a4c7ea2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Acquiring lock "cinder-quobyte-89fc48c1-1637-4ef7-ad80-20778a4c7ea2" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Lock "cinder-quobyte-89fc48c1-1637-4ef7-ad80-20778a4c7ea2" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f483b23-3a2c-4a56-9390-20e22534c20d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:47:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:11 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 Sep 07 16:47:11 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:11 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2" returned: 0 in 0.542s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:11 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2 Sep 07 16:47:11 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:11 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89fc48c1-1637-4ef7-ad80-20778a4c7ea2" returned: 0 in 0.319s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Lock "cinder-quobyte-89fc48c1-1637-4ef7-ad80-20778a4c7ea2" released by "delete_volume" :: held 0.964s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:11 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Created reservations ['fc3ff0da-85db-4e04-bb79-49362ee2aafc', '8e847a94-e738-44ea-b2eb-25831abd3000', 'c2569532-1939-43ef-b971-f2e9cfa0f39a', 'c0ded3e3-57d1-44a9-b862-5b2c7541a9e3'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:12 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:12 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Acquiring lock "cinder-46ff1cf4-8e81-42ef-8324-330473276605-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-46ff1cf4-8e81-42ef-8324-330473276605-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Acquiring lock "cinder-quobyte-46ff1cf4-8e81-42ef-8324-330473276605" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:12 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.404s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-quobyte-46ff1cf4-8e81-42ef-8324-330473276605" acquired by "delete_volume" :: waited 0.039s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:12 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Deleted volume successfully. Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f204c7d1-a241-4857-a3a9-ba0853c031f9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a527529b-2f9d-4ff0-8979-de482e42c32f tempest-VolumesListTestJSON-990244954 None] Lock "cinder-89fc48c1-1637-4ef7-ad80-20778a4c7ea2-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:12 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 Sep 07 16:47:12 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:13 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605" returned: 0 in 0.485s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:13 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605 Sep 07 16:47:13 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:13 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-46ff1cf4-8e81-42ef-8324-330473276605" returned: 0 in 0.259s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-quobyte-46ff1cf4-8e81-42ef-8324-330473276605" released by "delete_volume" :: held 0.817s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Created reservations ['a444d992-5a4c-418c-a56d-50e38fc742c6', 'eba8f808-6087-42cf-8dbd-074050646204', '077b76c5-2d2b-4bca-8deb-bde5d3adc7e6', 'dcf91b0d-1468-4354-8418-eaa11b99d147'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:13 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:13 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:13 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.333s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Deleted volume successfully. Sep 07 16:47:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4239e476-5da4-4329-9197-2d4ef5af7c41 tempest-VolumesListTestJSON-990244954 None] Lock "cinder-46ff1cf4-8e81-42ef-8324-330473276605-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:17 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:47:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Flow 'volume_create_manager' (de770ee0-3680-4699-9e08-fe67e701f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3b332c-007f-44e9-8856-787b2f9a597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3b332c-007f-44e9-8856-787b2f9a597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1045011982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664a10f2-638b-4c9a-a789-c4838b730e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c376c55e1144b294ca92980f5aa0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:18Z,use_quota=True,user_id='aad2f9673dc94f25b562362170777e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0177c7fb-eb79-47ec-951f-fa194077b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0177c7fb-eb79-47ec-951f-fa194077b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c617f7-508e-4ca2-ae1e-cf52073216e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c617f7-508e-4ca2-ae1e-cf52073216e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664a10f2-638b-4c9a-a789-c4838b730e8a', 'volume_name': 'volume-664a10f2-638b-4c9a-a789-c4838b730e8a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f1e771-571a-43e7-ab9c-942b092b0539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f1e771-571a-43e7-ab9c-942b092b0539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed553e39-a304-486e-8187-65cafb44c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Volume 664a10f2-638b-4c9a-a789-c4838b730e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664a10f2-638b-4c9a-a789-c4838b730e8a', 'volume_size': 1} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1045011982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664a10f2-638b-4c9a-a789-c4838b730e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59c376c55e1144b294ca92980f5aa0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:18Z,use_quota=True,user_id='aad2f9673dc94f25b562362170777e2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Creating volume 664a10f2-638b-4c9a-a789-c4838b730e8a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:47:18 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:18 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a 1073741824 Sep 07 16:47:18 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:18 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a 1073741824" returned: 0 in 0.469s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:18 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a Sep 07 16:47:18 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Flow 'volume_create_manager' (a9bb6a79-3318-4015-93ae-2e2e8d10a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e496090-21d1-4de8-8005-cb808956ca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=73,cinder:UPDATE=86,cinder:DELETE=4,cinder:INSERT=18 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:47:18 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e496090-21d1-4de8-8005-cb808956ca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-937502086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698381d2-7742-48c5-84f9-7685787ce33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d541997e3dfe4b42a8eaa309efef57e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:19Z,use_quota=True,user_id='00563c15eb1c42e6b2d446d9426accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909eafb8-de31-4135-b23b-1a895c263853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909eafb8-de31-4135-b23b-1a895c263853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5b4e85-bd2b-4c14-a780-3145cc65b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5b4e85-bd2b-4c14-a780-3145cc65b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '698381d2-7742-48c5-84f9-7685787ce33d', 'volume_name': 'volume-698381d2-7742-48c5-84f9-7685787ce33d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b41565-224f-4431-b748-d7d478a7764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b41565-224f-4431-b748-d7d478a7764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34c2b0c-8536-4a8f-ae3d-3b37ae074432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Volume 698381d2-7742-48c5-84f9-7685787ce33d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-698381d2-7742-48c5-84f9-7685787ce33d', 'volume_size': 1} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a" returned: 0 in 0.306s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-937502086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698381d2-7742-48c5-84f9-7685787ce33d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d541997e3dfe4b42a8eaa309efef57e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:19Z,use_quota=True,user_id='00563c15eb1c42e6b2d446d9426accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Creating volume 698381d2-7742-48c5-84f9-7685787ce33d {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:47:18 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=74,cinder:UPDATE=77,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:47:18 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d 1073741824 Sep 07 16:47:18 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed553e39-a304-486e-8187-65cafb44c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664a10f2-638b-4c9a-a789-c4838b730e8a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399daf18-904b-4ede-af53-63d394acb91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:18 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Volume volume-664a10f2-638b-4c9a-a789-c4838b730e8a (664a10f2-638b-4c9a-a789-c4838b730e8a): created successfully Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399daf18-904b-4ede-af53-63d394acb91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Flow 'volume_create_manager' (de770ee0-3680-4699-9e08-fe67e701f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f4135951-4f5d-4151-a9a6-564d849aa291 tempest-VolumesNegativeTest-888105206 None] Created volume successfully. Sep 07 16:47:19 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d 1073741824" returned: 0 in 0.429s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:19 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d Sep 07 16:47:19 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:19 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d" returned: 0 in 0.247s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34c2b0c-8536-4a8f-ae3d-3b37ae074432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698381d2-7742-48c5-84f9-7685787ce33d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c6579e-884c-4795-8402-8a0b7511f1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:19 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Volume volume-698381d2-7742-48c5-84f9-7685787ce33d (698381d2-7742-48c5-84f9-7685787ce33d): created successfully Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c6579e-884c-4795-8402-8a0b7511f1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Flow 'volume_create_manager' (a9bb6a79-3318-4015-93ae-2e2e8d10a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-abe03be4-a010-46f3-a01c-6260ff1f11a1 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Created volume successfully. Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Acquiring lock "cinder-698381d2-7742-48c5-84f9-7685787ce33d-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "cinder-698381d2-7742-48c5-84f9-7685787ce33d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Acquiring lock "cinder-quobyte-698381d2-7742-48c5-84f9-7685787ce33d" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "cinder-quobyte-698381d2-7742-48c5-84f9-7685787ce33d" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c7c78e-b018-4e07-be56-984d69ec4411]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:47:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:20 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d Sep 07 16:47:20 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:20 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d" returned: 0 in 0.391s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:20 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d Sep 07 16:47:20 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:20 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-698381d2-7742-48c5-84f9-7685787ce33d" returned: 0 in 0.278s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "cinder-quobyte-698381d2-7742-48c5-84f9-7685787ce33d" released by "delete_volume" :: held 0.719s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Created reservations ['2a723f45-6497-423e-acff-7564be577e43', 'ccb9c7a4-10f1-4df7-a95c-82e7b5721f81', '79907df7-abd3-498f-a838-e0ca9d14a8b1', '6d794393-88d6-46d5-a3c4-eb1a42bac0e0'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:20 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:20 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:21 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.272s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Deleted volume successfully. Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e6fc336a-c705-4293-a935-a24d52ddfd73 tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "cinder-698381d2-7742-48c5-84f9-7685787ce33d-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Flow 'volume_create_manager' (04dcb16e-61e2-453c-b87c-59545c2a0fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4493cbb0-4b01-439c-8588-bc0e22faa18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4493cbb0-4b01-439c-8588-bc0e22faa18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-694520891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a98801-db60-4280-9f8b-518fc07d37d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d541997e3dfe4b42a8eaa309efef57e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:21Z,use_quota=True,user_id='00563c15eb1c42e6b2d446d9426accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08fb7a9-6a97-4300-85fe-38cd71eac597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08fb7a9-6a97-4300-85fe-38cd71eac597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04964e3-d95b-4f9c-afbb-88806d879aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04964e3-d95b-4f9c-afbb-88806d879aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13a98801-db60-4280-9f8b-518fc07d37d1', 'volume_name': 'volume-13a98801-db60-4280-9f8b-518fc07d37d1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74afc13d-ec8b-479b-87e3-99c6a6ca269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74afc13d-ec8b-479b-87e3-99c6a6ca269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7addaa5a-48da-417d-a1e2-367fbd771042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:21 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Volume 13a98801-db60-4280-9f8b-518fc07d37d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13a98801-db60-4280-9f8b-518fc07d37d1', 'volume_size': 1} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-694520891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a98801-db60-4280-9f8b-518fc07d37d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d541997e3dfe4b42a8eaa309efef57e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:21Z,use_quota=True,user_id='00563c15eb1c42e6b2d446d9426accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Creating volume 13a98801-db60-4280-9f8b-518fc07d37d1 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:47:21 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:47:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:21 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 1073741824 Sep 07 16:47:21 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:22 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 1073741824" returned: 0 in 0.523s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:22 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 Sep 07 16:47:22 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:22 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1" returned: 0 in 0.284s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7addaa5a-48da-417d-a1e2-367fbd771042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a98801-db60-4280-9f8b-518fc07d37d1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de74969-faba-4292-a979-b21ca0da7b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:22 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Volume volume-13a98801-db60-4280-9f8b-518fc07d37d1 (13a98801-db60-4280-9f8b-518fc07d37d1): created successfully Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de74969-faba-4292-a979-b21ca0da7b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Flow 'volume_create_manager' (04dcb16e-61e2-453c-b87c-59545c2a0fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e8d2c056-c058-43aa-9130-0e0824281b4b tempest-VolumeQuotasAdminTestJSON-1644911048 None] Created volume successfully. Sep 07 16:47:24 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-aa20d7ff-a630-4e79-a939-e9165f19cfd1 tempest-VolumeQuotasAdminTestJSON-1763333297 None] Transfer volume completed successfully. Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Acquiring lock "cinder-13a98801-db60-4280-9f8b-518fc07d37d1-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Lock "cinder-13a98801-db60-4280-9f8b-518fc07d37d1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Acquiring lock "cinder-quobyte-13a98801-db60-4280-9f8b-518fc07d37d1" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Lock "cinder-quobyte-13a98801-db60-4280-9f8b-518fc07d37d1" acquired by "delete_volume" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad72515c-3f38-4487-9604-4f8a4566b1ac]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:25 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 Sep 07 16:47:25 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:25 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1" returned: 0 in 0.665s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:25 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1 Sep 07 16:47:25 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:26 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13a98801-db60-4280-9f8b-518fc07d37d1" returned: 0 in 0.513s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Lock "cinder-quobyte-13a98801-db60-4280-9f8b-518fc07d37d1" released by "delete_volume" :: held 1.290s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Created reservations ['33aa9b31-73e0-4a35-8442-a846e4b3989a', 'd75cb3c5-c921-48dc-9118-533afb88c9ae', '39591c06-c8c1-4e96-9e9a-136ab3970325', '69ffe846-eb3d-4819-a56b-fb514ec08c94'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:26 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:26 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:27 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.556s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:27 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Deleted volume successfully. Sep 07 16:47:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8475f0cb-b6a1-4e86-b253-18f1d2aaf921 tempest-VolumeQuotasAdminTestJSON-1713552705 None] Lock "cinder-13a98801-db60-4280-9f8b-518fc07d37d1-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-c06836b6-52e4-4ece-b076-5cb423546ffb req-f1eededb-9b4f-47e1-98f3-03fef017108d tempest-AttachVolumeTestJSON-1159535621 None] Terminate volume connection completed successfully. Sep 07 16:47:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-c06836b6-52e4-4ece-b076-5cb423546ffb req-f1eededb-9b4f-47e1-98f3-03fef017108d tempest-AttachVolumeTestJSON-1159535621 None] Deleting attachment ac5298c5-8462-49fd-b49d-5ac374bbc4aa. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:33 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:33 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:33 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.393s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:47:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:47:37 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=26,cinder:SELECT=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:47:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-922038f0-f278-47cd-a05f-81f8415b3c87 req-21371782-7fb6-40de-8046-f2a7bc6e14be tempest-AttachVolumeNegativeTest-310406525 None] Terminate volume connection completed successfully. Sep 07 16:47:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-922038f0-f278-47cd-a05f-81f8415b3c87 req-21371782-7fb6-40de-8046-f2a7bc6e14be tempest-AttachVolumeNegativeTest-310406525 None] Deleting attachment 570981c0-41e0-4771-9161-14bba1f1867e. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Flow 'volume_create_manager' (f991063a-491a-4a52-a9b2-934bb1adeac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be1dee0-409a-4ff5-91ca-b1c21c410728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be1dee0-409a-4ff5-91ca-b1c21c410728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-414460351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24783b88-f740-4e28-b81b-115b211504fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7770829114e1ca895b8d2e38758a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:42Z,use_quota=True,user_id='571ebdf252424c15ae449920dbd28a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(234f0072-2b83-445a-88aa-a04133c9beee),volume_type_id=234f0072-2b83-445a-88aa-a04133c9beee)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78e7e29-567c-47e5-9d4d-a6ecfcfce0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78e7e29-567c-47e5-9d4d-a6ecfcfce0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b1e343-bcf2-4670-8eb5-87031d9b2aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b1e343-bcf2-4670-8eb5-87031d9b2aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24783b88-f740-4e28-b81b-115b211504fa', 'volume_name': 'volume-24783b88-f740-4e28-b81b-115b211504fa', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9b7ea6-34b1-4cde-b9a5-ac17e60b1843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9b7ea6-34b1-4cde-b9a5-ac17e60b1843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf421f6f-79f2-4853-b2e9-1723aa33f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:42 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Volume 24783b88-f740-4e28-b81b-115b211504fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24783b88-f740-4e28-b81b-115b211504fa', 'volume_size': 1} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-414460351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24783b88-f740-4e28-b81b-115b211504fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7770829114e1ca895b8d2e38758a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:42Z,use_quota=True,user_id='571ebdf252424c15ae449920dbd28a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(234f0072-2b83-445a-88aa-a04133c9beee),volume_type_id=234f0072-2b83-445a-88aa-a04133c9beee)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Creating volume 24783b88-f740-4e28-b81b-115b211504fa {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:47:42 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:47:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:42 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa 1073741824 Sep 07 16:47:42 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:43 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa 1073741824" returned: 0 in 0.675s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:43 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa Sep 07 16:47:43 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:43 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa" returned: 0 in 0.343s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf421f6f-79f2-4853-b2e9-1723aa33f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24783b88-f740-4e28-b81b-115b211504fa', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002d929a-3a13-421f-9729-1a150f6a1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:43 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Volume volume-24783b88-f740-4e28-b81b-115b211504fa (24783b88-f740-4e28-b81b-115b211504fa): created successfully Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002d929a-3a13-421f-9729-1a150f6a1767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Flow 'volume_create_manager' (f991063a-491a-4a52-a9b2-934bb1adeac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-93176b23-9c77-46b5-87f6-35e30a8fc250 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Created volume successfully. Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Acquiring lock "cinder-664a10f2-638b-4c9a-a789-c4838b730e8a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Lock "cinder-664a10f2-638b-4c9a-a789-c4838b730e8a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Acquiring lock "cinder-quobyte-664a10f2-638b-4c9a-a789-c4838b730e8a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Lock "cinder-quobyte-664a10f2-638b-4c9a-a789-c4838b730e8a" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fbf815-abb1-4f78-ac90-85bb8722798a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:45 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:45 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:45 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a Sep 07 16:47:45 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:45 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.301s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c470101f-207e-4326-94a3-5b3f4e35f5cd tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Retype volume completed successfully. Sep 07 16:47:45 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a" returned: 0 in 0.497s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:45 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a Sep 07 16:47:45 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:46 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-664a10f2-638b-4c9a-a789-c4838b730e8a" returned: 0 in 0.298s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Lock "cinder-quobyte-664a10f2-638b-4c9a-a789-c4838b730e8a" released by "delete_volume" :: held 0.869s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Created reservations ['315e4ba6-ee2e-4a9c-8b80-0e38f4dc31bb', '2ad8c77e-ebe3-466a-8d96-780a7c87681c', 'a906b38f-eb30-4902-a6d1-1aa61e8625f3', '61c300b2-c293-4b1d-8702-4d210535db79'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:46 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:46 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Acquiring lock "cinder-24783b88-f740-4e28-b81b-115b211504fa-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "cinder-24783b88-f740-4e28-b81b-115b211504fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Acquiring lock "cinder-quobyte-24783b88-f740-4e28-b81b-115b211504fa" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "cinder-quobyte-24783b88-f740-4e28-b81b-115b211504fa" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1811ae43-6607-4276-addf-afc18f7b7e2e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:46 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.394s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Deleted volume successfully. Sep 07 16:47:46 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa Sep 07 16:47:46 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-346298c4-f84f-4044-98e8-5033d3a29f7e tempest-VolumesNegativeTest-888105206 None] Lock "cinder-664a10f2-638b-4c9a-a789-c4838b730e8a-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:47 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa" returned: 0 in 0.424s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:47 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa Sep 07 16:47:47 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:47 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-24783b88-f740-4e28-b81b-115b211504fa" returned: 0 in 0.309s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "cinder-quobyte-24783b88-f740-4e28-b81b-115b211504fa" released by "delete_volume" :: held 0.807s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:47 devstack cinder-volume[87492]: WARNING cinder.quota [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:47:47 devstack cinder-volume[87492]: WARNING cinder.quota [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Created reservations ['d4276220-8ddf-4278-8247-93f051f28645', '0bca7d43-dfa8-4518-93b7-7329224fc87f', 'b649a378-a802-4ea4-8c95-3e09411aeb6d', '6b30eba2-e4ce-4cd4-bda4-3c390f386055'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:47 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:47:47 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:47:48 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 07 16:47:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.501s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:47:48 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:47:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Deleted volume successfully. Sep 07 16:47:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-01145feb-0de6-4ba3-89d4-5633e41ba0c2 tempest-VolumeRetypeWithoutMigrationTest-2134670534 None] Lock "cinder-24783b88-f740-4e28-b81b-115b211504fa-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Flow 'volume_create_manager' (48e6c608-218b-4f5c-ab6e-5c023b1c8c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb607c9-3e13-4bc8-b6c6-2e1dd7b2a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb607c9-3e13-4bc8-b6c6-2e1dd7b2a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1208403814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a6052f-0f12-49ce-8d23-a12127b2876f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6944833b4d4ed99467a3e80b67e1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:59Z,use_quota=True,user_id='7167952f8add4654b8773f9e978af6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156f629f-4bff-48bc-ae6c-87adaf565ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156f629f-4bff-48bc-ae6c-87adaf565ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cbd54a-ab07-40ce-a220-4b2d1dfffbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cbd54a-ab07-40ce-a220-4b2d1dfffbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a6052f-0f12-49ce-8d23-a12127b2876f', 'volume_name': 'volume-f9a6052f-0f12-49ce-8d23-a12127b2876f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36aabf9-7cd4-4d75-81a4-a3a225d0f525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36aabf9-7cd4-4d75-81a4-a3a225d0f525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fde1d7-1ab6-4e09-ab6e-824e66ef176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:47:59 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Volume f9a6052f-0f12-49ce-8d23-a12127b2876f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a6052f-0f12-49ce-8d23-a12127b2876f', 'volume_size': 1} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1208403814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a6052f-0f12-49ce-8d23-a12127b2876f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6944833b4d4ed99467a3e80b67e1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:47:59Z,use_quota=True,user_id='7167952f8add4654b8773f9e978af6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Creating volume f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:47:59 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:47:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:47:59 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f 1073741824 Sep 07 16:47:59 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:00 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f 1073741824" returned: 0 in 1.111s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:00 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f Sep 07 16:48:00 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:00 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:48:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fde1d7-1ab6-4e09-ab6e-824e66ef176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a6052f-0f12-49ce-8d23-a12127b2876f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3ce463-a60e-49fc-a20a-4713b6404bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:01 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Volume volume-f9a6052f-0f12-49ce-8d23-a12127b2876f (f9a6052f-0f12-49ce-8d23-a12127b2876f): created successfully Sep 07 16:48:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3ce463-a60e-49fc-a20a-4713b6404bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Flow 'volume_create_manager' (48e6c608-218b-4f5c-ab6e-5c023b1c8c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-42ec7822-7e24-4991-9331-af4005fb8c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Created volume successfully. Sep 07 16:48:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Creating offline snapshot d31aea84-ca03-4116-816b-174d8d2202e3 of volume f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:48:02 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b68820-a689-420f-b1d5-f416eda9181e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:48:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:02 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f Sep 07 16:48:02 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:02 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f" returned: 0 in 0.698s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:02 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 1G Sep 07 16:48:02 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:03 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 1G" returned: 0 in 0.602s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a6052f-0f12-49ce-8d23-a12127b2876f -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:03 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a6052f-0f12-49ce-8d23-a12127b2876f -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 Sep 07 16:48:03 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:03 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a6052f-0f12-49ce-8d23-a12127b2876f -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3" returned: 0 in 0.513s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:03 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 is being set with open permissions: ugo+rw Sep 07 16:48:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:04 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 Sep 07 16:48:04 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:04 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3" returned: 0 in 0.465s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:04 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.info Sep 07 16:48:04 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:04 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.info" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:04 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.info is being set with open permissions: ugo+rw Sep 07 16:48:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:04 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.info Sep 07 16:48:04 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:05 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.info" returned: 0 in 0.326s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.288s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8a1dc0f9-0f75-4575-ab91-149435dd76d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Create snapshot completed successfully Sep 07 16:48:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "cinder-d31aea84-ca03-4116-816b-174d8d2202e3-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:48:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-d31aea84-ca03-4116-816b-174d8d2202e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:48:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "cinder-quobyte-f9a6052f-0f12-49ce-8d23-a12127b2876f" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-quobyte-f9a6052f-0f12-49ce-8d23-a12127b2876f" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "cinder-quobyte-d31aea84-ca03-4116-816b-174d8d2202e3" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-quobyte-d31aea84-ca03-4116-816b-174d8d2202e3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Deleting offline snapshot d31aea84-ca03-4116-816b-174d8d2202e3 of volume f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] snapshot_file for this snap is: volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f9110f-f646-4f9c-b6c3-b37db53351ae]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:07 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 Sep 07 16:48:07 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:07 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3" returned: 0 in 0.624s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9a6052f-0f12-49ce-8d23-a12127b2876f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e87cd63-277e-4126-bb33-b27e2463d1d2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:48:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:08 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f Sep 07 16:48:08 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:08 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f" returned: 0 in 0.669s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:08 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 Sep 07 16:48:08 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:09 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3" returned: 0 in 0.693s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:09 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3 Sep 07 16:48:09 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:09 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f.d31aea84-ca03-4116-816b-174d8d2202e3" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-quobyte-d31aea84-ca03-4116-816b-174d8d2202e3" released by "_delete_snapshot" :: held 2.551s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:48:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-quobyte-f9a6052f-0f12-49ce-8d23-a12127b2876f" released by "delete_snapshot" :: held 2.589s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:48:09 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Created reservations ['b0a611eb-b141-4b35-8a07-1397216e6d15', 'c04a6131-4cf9-4c0d-a8ed-61f54c6c00ae', '978e5c02-e672-440b-96fa-28e92c401959', 'ad95d33e-b92b-4f5a-99c7-6891362f7bf5'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:48:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Delete snapshot completed successfully. Sep 07 16:48:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f5fce3c-1743-4f3e-9e2e-40c38e0a6f49 tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-d31aea84-ca03-4116-816b-174d8d2202e3-delete_snapshot" released by "delete_snapshot" :: held 2.824s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "cinder-f9a6052f-0f12-49ce-8d23-a12127b2876f-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-f9a6052f-0f12-49ce-8d23-a12127b2876f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "cinder-quobyte-f9a6052f-0f12-49ce-8d23-a12127b2876f" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-quobyte-f9a6052f-0f12-49ce-8d23-a12127b2876f" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbbefe4-3d40-478a-b781-779b5fb8fb95]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:10 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f Sep 07 16:48:10 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:10 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f" returned: 0 in 0.436s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:10 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f Sep 07 16:48:10 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:11 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f9a6052f-0f12-49ce-8d23-a12127b2876f" returned: 0 in 0.303s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-quobyte-f9a6052f-0f12-49ce-8d23-a12127b2876f" released by "delete_volume" :: held 0.833s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Created reservations ['61016fa1-6901-410f-8d92-1266a7f575c7', '38dcb738-af55-410d-aa1c-b16e5f48d2a7', '43283ce4-87dd-42e9-a29e-753a00e65612', 'fc9f7710-bfb0-4cdf-bb21-476e093a62fb'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:11 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:48:11 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:11 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.319s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:48:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Deleted volume successfully. Sep 07 16:48:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-247c0d88-78f2-4e51-bac9-21d81510dc6e tempest-VolumeSnapshotQuotasNegativeTestJSON-814050252 None] Lock "cinder-f9a6052f-0f12-49ce-8d23-a12127b2876f-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=66,cinder:DELETE=6,cinder:SELECT=54,cinder:INSERT=13 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Flow 'volume_create_manager' (30dba98d-06cd-4693-8ced-c9d590a49814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fc7b8d-1e6c-4850-867c-b049e18c19fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fc7b8d-1e6c-4850-867c-b049e18c19fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-913489466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f455b243-4224-4aaf-b4bd-656f75ea51dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43ff57b14654fe5a5fa7f2dc7982c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:19Z,use_quota=True,user_id='aad9c52666fc434896e6f30cab7400da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3cc9ae-7b6c-46c1-9f5b-fa7d40997458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b3cc9ae-7b6c-46c1-9f5b-fa7d40997458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6f5e85-67fe-435a-bbb3-81271570455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6f5e85-67fe-435a-bbb3-81271570455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f455b243-4224-4aaf-b4bd-656f75ea51dd', 'volume_name': 'volume-f455b243-4224-4aaf-b4bd-656f75ea51dd', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7245c902-d0ea-4648-a4f9-e95f8c24144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7245c902-d0ea-4648-a4f9-e95f8c24144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661fccd6-1777-448c-8fe2-0258cfa5f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:19 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Volume f455b243-4224-4aaf-b4bd-656f75ea51dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f455b243-4224-4aaf-b4bd-656f75ea51dd', 'volume_size': 1} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-913489466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f455b243-4224-4aaf-b4bd-656f75ea51dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43ff57b14654fe5a5fa7f2dc7982c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:19Z,use_quota=True,user_id='aad9c52666fc434896e6f30cab7400da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Creating volume f455b243-4224-4aaf-b4bd-656f75ea51dd {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:48:19 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:48:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:19 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd 1073741824 Sep 07 16:48:19 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:20 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd 1073741824" returned: 0 in 0.742s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:20 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd Sep 07 16:48:20 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Flow 'volume_create_manager' (fe2ac567-6dd8-4c04-a4df-eaadcddd9b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf8433e-53b6-4763-8357-05df014a8b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf8433e-53b6-4763-8357-05df014a8b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-73404145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4068e532-606c-4777-acf0-032c1ac67d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e0d3ae8b3341c8845c4387200d8771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:21Z,use_quota=True,user_id='76e48a3625da420a84c8624dc1d6223e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679007ea-98a5-4679-a0f1-5535311eb794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679007ea-98a5-4679-a0f1-5535311eb794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef235995-47ad-46c3-9780-95a64b6ea55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef235995-47ad-46c3-9780-95a64b6ea55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4068e532-606c-4777-acf0-032c1ac67d3a', 'volume_name': 'volume-4068e532-606c-4777-acf0-032c1ac67d3a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2971bdf8-c3e0-4c43-a8e1-90e76f3db690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2971bdf8-c3e0-4c43-a8e1-90e76f3db690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771fec1e-da30-4072-98fa-38d71b5fd6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:20 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Volume 4068e532-606c-4777-acf0-032c1ac67d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4068e532-606c-4777-acf0-032c1ac67d3a', 'volume_size': 1} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:20 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd" returned: 0 in 0.469s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-73404145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4068e532-606c-4777-acf0-032c1ac67d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e0d3ae8b3341c8845c4387200d8771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:21Z,use_quota=True,user_id='76e48a3625da420a84c8624dc1d6223e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Creating volume 4068e532-606c-4777-acf0-032c1ac67d3a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:48:20 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661fccd6-1777-448c-8fe2-0258cfa5f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f455b243-4224-4aaf-b4bd-656f75ea51dd', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:20 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a 1073741824 Sep 07 16:48:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b8ccf1-f841-4ded-80ad-32da0f149f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:20 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:21 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Volume volume-f455b243-4224-4aaf-b4bd-656f75ea51dd (f455b243-4224-4aaf-b4bd-656f75ea51dd): created successfully Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b8ccf1-f841-4ded-80ad-32da0f149f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Flow 'volume_create_manager' (30dba98d-06cd-4693-8ced-c9d590a49814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d9f5f91d-3a82-4309-b43f-83352e822408 tempest-AttachVolumeNegativeTest-310406525 None] Created volume successfully. Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Flow 'volume_create_manager' (8a2ac1b3-9fd6-4c69-a4d8-e6195178fa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37dda35-63de-4371-9223-f5285437288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37dda35-63de-4371-9223-f5285437288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-638293503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dcef68-420e-4daf-b877-d2102737cc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e0d3ae8b3341c8845c4387200d8771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:21Z,use_quota=True,user_id='76e48a3625da420a84c8624dc1d6223e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2865774-1cf5-473a-bd57-5bd7822788a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2865774-1cf5-473a-bd57-5bd7822788a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a2299d-be7d-4923-80d3-96b89f859153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a2299d-be7d-4923-80d3-96b89f859153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71dcef68-420e-4daf-b877-d2102737cc77', 'volume_name': 'volume-71dcef68-420e-4daf-b877-d2102737cc77', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf221bc-b13a-4e84-aba2-dd8eda267f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf221bc-b13a-4e84-aba2-dd8eda267f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6ce76e-c6da-48b4-a67a-bd4e59013129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:21 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Volume 71dcef68-420e-4daf-b877-d2102737cc77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71dcef68-420e-4daf-b877-d2102737cc77', 'volume_size': 1} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:21 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a 1073741824" returned: 0 in 0.864s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:21 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a Sep 07 16:48:21 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:22 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a" returned: 0 in 0.356s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-638293503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dcef68-420e-4daf-b877-d2102737cc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e0d3ae8b3341c8845c4387200d8771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:21Z,use_quota=True,user_id='76e48a3625da420a84c8624dc1d6223e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Creating volume 71dcef68-420e-4daf-b877-d2102737cc77 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:48:22 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771fec1e-da30-4072-98fa-38d71b5fd6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4068e532-606c-4777-acf0-032c1ac67d3a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:22 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 1073741824 Sep 07 16:48:22 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1361ff-1c2f-4f8c-96e4-417734f473a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:22 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Volume volume-4068e532-606c-4777-acf0-032c1ac67d3a (4068e532-606c-4777-acf0-032c1ac67d3a): created successfully Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1361ff-1c2f-4f8c-96e4-417734f473a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Flow 'volume_create_manager' (fe2ac567-6dd8-4c04-a4df-eaadcddd9b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9ae97387-51c1-4551-992c-9b5976638f5a tempest-TestServerVolumeAttachmentScenario-1873876482 None] Created volume successfully. Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-805d0bcc-e01b-424b-a171-967521e541eb req-dafc1166-e188-44ea-b9ba-8ea5d924f645 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:22 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 1073741824" returned: 0 in 0.745s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:23 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 Sep 07 16:48:23 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:23 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77" returned: 0 in 0.347s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-805d0bcc-e01b-424b-a171-967521e541eb req-dafc1166-e188-44ea-b9ba-8ea5d924f645 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.631s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-805d0bcc-e01b-424b-a171-967521e541eb req-dafc1166-e188-44ea-b9ba-8ea5d924f645 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6ce76e-c6da-48b4-a67a-bd4e59013129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71dcef68-420e-4daf-b877-d2102737cc77', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2987866d-7077-47c0-99c3-051433a191e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:23 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Volume volume-71dcef68-420e-4daf-b877-d2102737cc77 (71dcef68-420e-4daf-b877-d2102737cc77): created successfully Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2987866d-7077-47c0-99c3-051433a191e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Flow 'volume_create_manager' (8a2ac1b3-9fd6-4c69-a4d8-e6195178fa44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-946ef1d4-2c84-47d0-a576-0ccb936e333d tempest-TestServerVolumeAttachmentScenario-1873876482 None] Created volume successfully. Sep 07 16:48:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-805d0bcc-e01b-424b-a171-967521e541eb req-dafc1166-e188-44ea-b9ba-8ea5d924f645 tempest-AttachVolumeNegativeTest-310406525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-f455b243-4224-4aaf-b4bd-656f75ea51dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39a51cfa-a8b4-4de6-af49-4d41fab08668', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:48:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-805d0bcc-e01b-424b-a171-967521e541eb req-dafc1166-e188-44ea-b9ba-8ea5d924f645 tempest-AttachVolumeNegativeTest-310406525 None] attachment_update completed successfully. Sep 07 16:48:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-88aeaa77-536e-4733-980b-5af5a1da24d6 req-6458b320-b089-456a-a48d-dae7b63939c4 tempest-AttachVolumeNegativeTest-310406525 None] Terminate volume connection completed successfully. Sep 07 16:48:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-88aeaa77-536e-4733-980b-5af5a1da24d6 req-6458b320-b089-456a-a48d-dae7b63939c4 tempest-AttachVolumeNegativeTest-310406525 None] Deleting attachment 39a51cfa-a8b4-4de6-af49-4d41fab08668. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:33 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:48:33 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=11,cinder:INSERT=3,cinder:SELECT=7,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:48:33 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.499s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:48:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:48:37 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=56,cinder:INSERT=12,cinder:UPDATE=47,cinder:DELETE=6 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:48:51 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:48:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Flow 'volume_create_manager' (71a79f81-4c97-463e-a420-d4168f4ed4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f2e339-5f3f-4c9b-8b04-55656ee54817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f2e339-5f3f-4c9b-8b04-55656ee54817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1105501597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36660510-5cc2-4bad-840e-09766e959f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40dfdc598e245cd888bc29dd01f7b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:52Z,use_quota=True,user_id='0ab5bf2fcafc4823911ac04c5d8a605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5db457f-a4bc-4f7c-8ef9-3cd217c4d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5db457f-a4bc-4f7c-8ef9-3cd217c4d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50566e5-4576-4d46-af06-f6c8aba21f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50566e5-4576-4d46-af06-f6c8aba21f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36660510-5cc2-4bad-840e-09766e959f65', 'volume_name': 'volume-36660510-5cc2-4bad-840e-09766e959f65', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b261d7b9-b291-4229-b5be-657dd71734c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b261d7b9-b291-4229-b5be-657dd71734c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0b9b0f-4681-4de3-b225-aa663419f915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:52 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Volume 36660510-5cc2-4bad-840e-09766e959f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36660510-5cc2-4bad-840e-09766e959f65', 'volume_size': 1} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1105501597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36660510-5cc2-4bad-840e-09766e959f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40dfdc598e245cd888bc29dd01f7b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:52Z,use_quota=True,user_id='0ab5bf2fcafc4823911ac04c5d8a605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Creating volume 36660510-5cc2-4bad-840e-09766e959f65 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:48:52 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:52 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 1073741824 Sep 07 16:48:52 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:52 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 1073741824" returned: 0 in 0.750s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:53 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 Sep 07 16:48:53 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:48:53 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 07 16:48:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65" returned: 0 in 0.343s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:48:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:48:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0b9b0f-4681-4de3-b225-aa663419f915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36660510-5cc2-4bad-840e-09766e959f65', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f69bd6-915b-4ee3-abe7-713f8deca791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Volume volume-36660510-5cc2-4bad-840e-09766e959f65 (36660510-5cc2-4bad-840e-09766e959f65): created successfully Sep 07 16:48:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f69bd6-915b-4ee3-abe7-713f8deca791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Flow 'volume_create_manager' (71a79f81-4c97-463e-a420-d4168f4ed4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a0760f8d-d917-44fc-90a4-de7a38219817 tempest-AttachVolumeTestJSON-1159535621 None] Created volume successfully. Sep 07 16:48:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1ef870cc-dfc5-4051-a567-c1193a99e7ee req-9889277d-9841-4a35-8f29-bd0224bae636 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1ef870cc-dfc5-4051-a567-c1193a99e7ee req-9889277d-9841-4a35-8f29-bd0224bae636 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1ef870cc-dfc5-4051-a567-c1193a99e7ee req-9889277d-9841-4a35-8f29-bd0224bae636 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-1ef870cc-dfc5-4051-a567-c1193a99e7ee req-9889277d-9841-4a35-8f29-bd0224bae636 tempest-AttachVolumeTestJSON-1159535621 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-36660510-5cc2-4bad-840e-09766e959f65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5246672-88e4-40c9-a37d-7d82abfd73b0', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:48:56 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-1ef870cc-dfc5-4051-a567-c1193a99e7ee req-9889277d-9841-4a35-8f29-bd0224bae636 tempest-AttachVolumeTestJSON-1159535621 None] attachment_update completed successfully. Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Flow 'volume_create_manager' (512c1127-6ffb-4611-a695-c600543d1e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ce1955-e38c-4300-b185-6a50939925f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ce1955-e38c-4300-b185-6a50939925f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2080585440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78124ee6-f0a5-43aa-b900-3ee469f80f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40dfdc598e245cd888bc29dd01f7b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:59Z,use_quota=True,user_id='0ab5bf2fcafc4823911ac04c5d8a605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c44044c-66c7-4d41-95b4-33d0bacf82de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c44044c-66c7-4d41-95b4-33d0bacf82de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdad71b-1b56-4817-ab62-876f862e08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdad71b-1b56-4817-ab62-876f862e08e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78124ee6-f0a5-43aa-b900-3ee469f80f69', 'volume_name': 'volume-78124ee6-f0a5-43aa-b900-3ee469f80f69', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9636ff0-eb7d-4873-a5d7-c136b8a72a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9636ff0-eb7d-4873-a5d7-c136b8a72a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bab917a-2762-41a6-b846-79f414c35db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:48:59 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Volume 78124ee6-f0a5-43aa-b900-3ee469f80f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78124ee6-f0a5-43aa-b900-3ee469f80f69', 'volume_size': 1} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2080585440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78124ee6-f0a5-43aa-b900-3ee469f80f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40dfdc598e245cd888bc29dd01f7b84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:48:59Z,use_quota=True,user_id='0ab5bf2fcafc4823911ac04c5d8a605e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Creating volume 78124ee6-f0a5-43aa-b900-3ee469f80f69 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:48:59 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:48:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:48:59 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 1073741824 Sep 07 16:48:59 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:00 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 1073741824" returned: 0 in 0.749s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:00 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 Sep 07 16:49:00 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:00 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69" returned: 0 in 0.305s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bab917a-2762-41a6-b846-79f414c35db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78124ee6-f0a5-43aa-b900-3ee469f80f69', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa30743-e29f-41df-8ff9-6c4a89ffa80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:00 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Volume volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 (78124ee6-f0a5-43aa-b900-3ee469f80f69): created successfully Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa30743-e29f-41df-8ff9-6c4a89ffa80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Flow 'volume_create_manager' (512c1127-6ffb-4611-a695-c600543d1e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9ef40cc6-c0a9-4b8b-bac7-756b2841354a tempest-AttachVolumeTestJSON-1159535621 None] Created volume successfully. Sep 07 16:49:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-5b1faa48-b862-4edb-a394-09449e20c000 req-9232bfff-13ae-463a-9f5f-86d99cbae79f tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-5b1faa48-b862-4edb-a394-09449e20c000 req-9232bfff-13ae-463a-9f5f-86d99cbae79f tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-5b1faa48-b862-4edb-a394-09449e20c000 req-9232bfff-13ae-463a-9f5f-86d99cbae79f tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-5b1faa48-b862-4edb-a394-09449e20c000 req-9232bfff-13ae-463a-9f5f-86d99cbae79f tempest-AttachVolumeTestJSON-1159535621 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-78124ee6-f0a5-43aa-b900-3ee469f80f69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6586cc50-3f6d-4d39-9dc6-61956d6342c7', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:49:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-5b1faa48-b862-4edb-a394-09449e20c000 req-9232bfff-13ae-463a-9f5f-86d99cbae79f tempest-AttachVolumeTestJSON-1159535621 None] attachment_update completed successfully. Sep 07 16:49:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-310ab631-b33e-4c48-977a-c48086fca753 req-71770b9e-fa58-4668-8c57-730d3d064e63 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-310ab631-b33e-4c48-977a-c48086fca753 req-71770b9e-fa58-4668-8c57-730d3d064e63 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-310ab631-b33e-4c48-977a-c48086fca753 req-71770b9e-fa58-4668-8c57-730d3d064e63 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-310ab631-b33e-4c48-977a-c48086fca753 req-71770b9e-fa58-4668-8c57-730d3d064e63 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-4068e532-606c-4777-acf0-032c1ac67d3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d787e51-e628-4e49-a0f8-7a1d3fd1d1ac', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:49:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-310ab631-b33e-4c48-977a-c48086fca753 req-71770b9e-fa58-4668-8c57-730d3d064e63 tempest-TestServerVolumeAttachmentScenario-1873876482 None] attachment_update completed successfully. Sep 07 16:49:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-7ff166dd-0704-414a-924f-e66424efbbb8 req-5d0a2a25-3ea0-4f7c-b7d4-759ce2812ccd tempest-AttachVolumeTestJSON-1159535621 None] Terminate volume connection completed successfully. Sep 07 16:49:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-7ff166dd-0704-414a-924f-e66424efbbb8 req-5d0a2a25-3ea0-4f7c-b7d4-759ce2812ccd tempest-AttachVolumeTestJSON-1159535621 None] Deleting attachment f5246672-88e4-40c9-a37d-7d82abfd73b0. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:49:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-86e0fd0a-a88d-4cb1-b7c4-5ec72ad6abf8 req-59a47a64-6d06-4a9e-abdf-7afbc3f3a6a6 tempest-AttachVolumeTestJSON-1159535621 None] Terminate volume connection completed successfully. Sep 07 16:49:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-86e0fd0a-a88d-4cb1-b7c4-5ec72ad6abf8 req-59a47a64-6d06-4a9e-abdf-7afbc3f3a6a6 tempest-AttachVolumeTestJSON-1159535621 None] Deleting attachment 6586cc50-3f6d-4d39-9dc6-61956d6342c7. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:49:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-5b77e909-b819-4eba-b2fb-b21c22d5c1b6 req-add006e7-2a6d-4bef-9a28-9a1104bd0057 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-5b77e909-b819-4eba-b2fb-b21c22d5c1b6 req-add006e7-2a6d-4bef-9a28-9a1104bd0057 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-5b77e909-b819-4eba-b2fb-b21c22d5c1b6 req-add006e7-2a6d-4bef-9a28-9a1104bd0057 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-5b77e909-b819-4eba-b2fb-b21c22d5c1b6 req-add006e7-2a6d-4bef-9a28-9a1104bd0057 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-71dcef68-420e-4daf-b877-d2102737cc77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37bbd71a-deff-4da5-864a-4283efc6a965', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:49:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-5b77e909-b819-4eba-b2fb-b21c22d5c1b6 req-add006e7-2a6d-4bef-9a28-9a1104bd0057 tempest-TestServerVolumeAttachmentScenario-1873876482 None] attachment_update completed successfully. Sep 07 16:49:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-b575c23b-83bd-45e9-a2d3-63039ef6dbd2 req-633fd359-b9d7-4332-b1fc-8f7d7b902c25 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Terminate volume connection completed successfully. Sep 07 16:49:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-b575c23b-83bd-45e9-a2d3-63039ef6dbd2 req-633fd359-b9d7-4332-b1fc-8f7d7b902c25 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Deleting attachment 37bbd71a-deff-4da5-864a-4283efc6a965. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:49:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-cc534eda-572d-4a80-8ec5-27d5836778bc req-b873f0fb-3b63-4d87-ba97-d41fb2bb1fe8 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Terminate volume connection completed successfully. Sep 07 16:49:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-cc534eda-572d-4a80-8ec5-27d5836778bc req-b873f0fb-3b63-4d87-ba97-d41fb2bb1fe8 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Deleting attachment 1d787e51-e628-4e49-a0f8-7a1d3fd1d1ac. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:49:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "cinder-78124ee6-f0a5-43aa-b900-3ee469f80f69-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-78124ee6-f0a5-43aa-b900-3ee469f80f69-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "cinder-quobyte-78124ee6-f0a5-43aa-b900-3ee469f80f69" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-quobyte-78124ee6-f0a5-43aa-b900-3ee469f80f69" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:14 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d276266-2888-4de4-91a5-9394ee2c5486]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:15 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 Sep 07 16:49:15 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:15 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69" returned: 0 in 0.654s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:15 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69 Sep 07 16:49:15 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:16 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-78124ee6-f0a5-43aa-b900-3ee469f80f69" returned: 0 in 0.395s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-quobyte-78124ee6-f0a5-43aa-b900-3ee469f80f69" released by "delete_volume" :: held 1.106s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Created reservations ['3224f9e0-34a3-4a1d-a107-16ac3c0d27e0', '896215f9-6d12-4db4-9dc6-87224372e23b', 'ff928bbe-07cb-427e-8a32-ecbec40370fa', 'ebec8d1e-dd8f-4abc-87ce-445c3e62b2d4'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:16 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:16 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:16 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.496s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Deleted volume successfully. Sep 07 16:49:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c733d01a-d52b-426d-82f8-d879faf09757 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-78124ee6-f0a5-43aa-b900-3ee469f80f69-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Flow 'volume_create_manager' (35f36aea-2ac5-4145-9449-ea2f37a77f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e567059-3afe-43db-b3a3-3722b32c292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "cinder-36660510-5cc2-4bad-840e-09766e959f65-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e567059-3afe-43db-b3a3-3722b32c292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-855980161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcd2632-0ef8-4fee-bffd-9446347d63f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43ff57b14654fe5a5fa7f2dc7982c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:17Z,use_quota=True,user_id='aad9c52666fc434896e6f30cab7400da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6041453e-eef8-4ffa-b56f-2d5e7dd72d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6041453e-eef8-4ffa-b56f-2d5e7dd72d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb73e67-55da-400b-827d-b7baa3b06bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb73e67-55da-400b-827d-b7baa3b06bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abcd2632-0ef8-4fee-bffd-9446347d63f1', 'volume_name': 'volume-abcd2632-0ef8-4fee-bffd-9446347d63f1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f530b05b-04f7-4b2e-b43f-4924645b3da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f530b05b-04f7-4b2e-b43f-4924645b3da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335a98ca-4aaf-4600-9513-39d6b6e4a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Volume abcd2632-0ef8-4fee-bffd-9446347d63f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abcd2632-0ef8-4fee-bffd-9446347d63f1', 'volume_size': 1} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-855980161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abcd2632-0ef8-4fee-bffd-9446347d63f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43ff57b14654fe5a5fa7f2dc7982c88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:17Z,use_quota=True,user_id='aad9c52666fc434896e6f30cab7400da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Creating volume abcd2632-0ef8-4fee-bffd-9446347d63f1 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:17 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-36660510-5cc2-4bad-840e-09766e959f65-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:17 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 1073741824 Sep 07 16:49:17 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "cinder-quobyte-36660510-5cc2-4bad-840e-09766e959f65" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-quobyte-36660510-5cc2-4bad-840e-09766e959f65" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e611c0a2-dde3-4733-856e-e469c48bdc0e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:17 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 Sep 07 16:49:17 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:18 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 1073741824" returned: 0 in 0.633s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:18 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65" returned: 0 in 0.530s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:18 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65 Sep 07 16:49:18 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:18 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 Sep 07 16:49:18 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:18 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36660510-5cc2-4bad-840e-09766e959f65" returned: 0 in 0.344s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-quobyte-36660510-5cc2-4bad-840e-09766e959f65" released by "delete_volume" :: held 0.933s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Created reservations ['2b67d318-c342-420c-86e4-fce487af8fec', 'a3428c37-4a58-4cc0-b445-d07948cf7817', 'e92c459d-a245-471f-9135-11b57e12ed33', '8e59de72-2824-4cf5-9c7a-e36173869fee'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:18 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1" returned: 0 in 0.457s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:18 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335a98ca-4aaf-4600-9513-39d6b6e4a138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abcd2632-0ef8-4fee-bffd-9446347d63f1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:18 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dc96e0-e3e4-48ba-9bdb-e4a048714c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:18 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Volume volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 (abcd2632-0ef8-4fee-bffd-9446347d63f1): created successfully Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dc96e0-e3e4-48ba-9bdb-e4a048714c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Flow 'volume_create_manager' (35f36aea-2ac5-4145-9449-ea2f37a77f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-32123d9c-8328-4673-b740-8557f60d9bb1 tempest-AttachVolumeNegativeTest-310406525 None] Created volume successfully. Sep 07 16:49:18 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.338s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:18 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Deleted volume successfully. Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aad6903f-cc9d-42be-b82f-f53e91df77fe tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-36660510-5cc2-4bad-840e-09766e959f65-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "cinder-71dcef68-420e-4daf-b877-d2102737cc77-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-71dcef68-420e-4daf-b877-d2102737cc77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "cinder-quobyte-71dcef68-420e-4daf-b877-d2102737cc77" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-quobyte-71dcef68-420e-4daf-b877-d2102737cc77" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02d4332-7dff-4466-919d-377853734ce6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:19 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 Sep 07 16:49:19 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "cinder-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "cinder-quobyte-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-quobyte-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143" acquired by "delete_volume" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac35b83-bcad-4911-a94d-22eecbbce038]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:20 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 Sep 07 16:49:20 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:20 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77" returned: 0 in 1.227s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:20 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77 Sep 07 16:49:20 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:20 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-c4baa84c-989c-4d59-8c6a-d5a61a58839b req-90e26cf1-c382-4eec-9910-155a55d9e932 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-c4baa84c-989c-4d59-8c6a-d5a61a58839b req-90e26cf1-c382-4eec-9910-155a55d9e932 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143" returned: 0 in 0.848s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-c4baa84c-989c-4d59-8c6a-d5a61a58839b req-90e26cf1-c382-4eec-9910-155a55d9e932 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:21 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143 Sep 07 16:49:21 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-c4baa84c-989c-4d59-8c6a-d5a61a58839b req-90e26cf1-c382-4eec-9910-155a55d9e932 tempest-AttachVolumeNegativeTest-310406525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-abcd2632-0ef8-4fee-bffd-9446347d63f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c336d6d5-5c65-4ac5-990f-05bd3f482689', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:49:21 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71dcef68-420e-4daf-b877-d2102737cc77" returned: 0 in 0.578s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-c4baa84c-989c-4d59-8c6a-d5a61a58839b req-90e26cf1-c382-4eec-9910-155a55d9e932 tempest-AttachVolumeNegativeTest-310406525 None] attachment_update completed successfully. Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-quobyte-71dcef68-420e-4daf-b877-d2102737cc77" released by "delete_volume" :: held 1.870s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Created reservations ['89dbec98-2758-48de-9ced-ce7ed71c5257', '09841a2e-f7cf-4dfc-9a4f-efc824ad3935', '7187d839-6d71-4e06-8142-e8cc4f20d985', '6f2288aa-3e1c-43c7-a5c2-84b03f788966'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:21 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143" returned: 0 in 0.677s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:21 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:21 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-quobyte-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143" released by "delete_volume" :: held 1.664s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Created reservations ['1b1b9c90-09a6-4eba-bd5e-d2170c0c1d26', '7e26b1ff-9bdd-49c0-ab1c-1c324e86f1f8', '370f8175-3e3e-4006-a1f8-465efcab8831', 'b1f92b88-2ded-43ca-9796-130170e8d821'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "cinder-4068e532-606c-4777-acf0-032c1ac67d3a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-4068e532-606c-4777-acf0-032c1ac67d3a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "cinder-quobyte-4068e532-606c-4777-acf0-032c1ac67d3a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:22 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-quobyte-4068e532-606c-4777-acf0-032c1ac67d3a" acquired by "delete_volume" :: waited 0.103s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:22 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:22 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.580s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Deleted volume successfully. Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3dc364-d7af-4cc6-a056-66a6ce87f9a7]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-358561aa-d293-473b-9e08-66ee2adfe084 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-71dcef68-420e-4daf-b877-d2102737cc77-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:22 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a Sep 07 16:49:22 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:22 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.603s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Deleted volume successfully. Sep 07 16:49:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-88feb37e-7486-4fa8-9dd1-0521ba89e873 tempest-AttachVolumeTestJSON-1159535621 None] Lock "cinder-2a3bd15f-35ea-4fb9-a53f-a8fe0f0ed143-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:23 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a" returned: 0 in 0.799s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:23 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a Sep 07 16:49:23 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:23 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4068e532-606c-4777-acf0-032c1ac67d3a" returned: 0 in 0.367s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-quobyte-4068e532-606c-4777-acf0-032c1ac67d3a" released by "delete_volume" :: held 1.313s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Created reservations ['4c09fb84-79c4-499a-98ed-5372e50189e8', '096b5e75-571e-4f6e-84e7-d7f17ccf2017', '6795eaa8-5d69-438a-98c3-5ee67c0223b2', 'bc52c212-039e-4b5e-947c-b03a5576468a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:23 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:23 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:23 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.350s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:23 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:24 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Deleted volume successfully. Sep 07 16:49:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-07aff892-52e5-4a44-91cc-ce45e1b1fe49 tempest-TestServerVolumeAttachmentScenario-1873876482 None] Lock "cinder-4068e532-606c-4777-acf0-032c1ac67d3a-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (240a5233-f6ed-4a0e-8cab-2b7683575085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1eaddcc-f273-436d-968c-9f9d83d5086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1eaddcc-f273-436d-968c-9f9d83d5086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-282122478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f24ea2-1500-4502-8928-2f36d6e56bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:25Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddd9396-7baa-40d3-9935-a6a3cd1e27d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddd9396-7baa-40d3-9935-a6a3cd1e27d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4d46f1-2631-492c-98c7-32e78a37efd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4d46f1-2631-492c-98c7-32e78a37efd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f24ea2-1500-4502-8928-2f36d6e56bf8', 'volume_name': 'volume-22f24ea2-1500-4502-8928-2f36d6e56bf8', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1488a89-d433-47de-8b54-84a3d7ec7a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1488a89-d433-47de-8b54-84a3d7ec7a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e3048-064f-4994-ba9e-fd81376dd9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Volume 22f24ea2-1500-4502-8928-2f36d6e56bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f24ea2-1500-4502-8928-2f36d6e56bf8', 'volume_size': 1} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-282122478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f24ea2-1500-4502-8928-2f36d6e56bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:25Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Creating volume 22f24ea2-1500-4502-8928-2f36d6e56bf8 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:25 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:25 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 1073741824 Sep 07 16:49:25 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-6c174360-9ccc-4cb3-9652-e163cd89c545 req-96fb1b21-c178-4d7c-8660-3cecb691a740 tempest-AttachVolumeNegativeTest-310406525 None] Terminate volume connection completed successfully. Sep 07 16:49:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-6c174360-9ccc-4cb3-9652-e163cd89c545 req-96fb1b21-c178-4d7c-8660-3cecb691a740 tempest-AttachVolumeNegativeTest-310406525 None] Deleting attachment c336d6d5-5c65-4ac5-990f-05bd3f482689. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:49:26 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 1073741824" returned: 0 in 0.749s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:26 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 Sep 07 16:49:26 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:26 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8" returned: 0 in 0.422s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e3048-064f-4994-ba9e-fd81376dd9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f24ea2-1500-4502-8928-2f36d6e56bf8', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d6fd46-2d44-41f2-8910-30a95a0cfb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Volume volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 (22f24ea2-1500-4502-8928-2f36d6e56bf8): created successfully Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d6fd46-2d44-41f2-8910-30a95a0cfb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (240a5233-f6ed-4a0e-8cab-2b7683575085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d2a93d0d-aa13-4ade-aa51-755f84dae850 tempest-VolumesActionsTest-497140434 None] Created volume successfully. Sep 07 16:49:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06c0c6a2-c146-4946-824c-5b3fde251644 tempest-VolumesActionsTest-497140434 None] Acquiring lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8" by "attach_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06c0c6a2-c146-4946-824c-5b3fde251644 tempest-VolumesActionsTest-497140434 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8" acquired by "attach_volume" :: waited 0.039s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-06c0c6a2-c146-4946-824c-5b3fde251644 tempest-VolumesActionsTest-497140434 None] Attaching volume 22f24ea2-1500-4502-8928-2f36d6e56bf8 to instance 8c5c80df-59ae-4183-b473-169491735c2f at mountpoint /dev/vdb on host None. Sep 07 16:49:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-06c0c6a2-c146-4946-824c-5b3fde251644 tempest-VolumesActionsTest-497140434 None] Attach volume completed successfully. Sep 07 16:49:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06c0c6a2-c146-4946-824c-5b3fde251644 tempest-VolumesActionsTest-497140434 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8" released by "attach_volume" :: held 0.148s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e57c9dc1-c8fc-491d-a192-c1a2f49ad291 tempest-VolumesActionsTest-1128324616 None] Terminate volume connection completed successfully. Sep 07 16:49:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e57c9dc1-c8fc-491d-a192-c1a2f49ad291 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-detach_volume" by "detach_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e57c9dc1-c8fc-491d-a192-c1a2f49ad291 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e57c9dc1-c8fc-491d-a192-c1a2f49ad291 tempest-VolumesActionsTest-1128324616 None] Detaching volume 22f24ea2-1500-4502-8928-2f36d6e56bf8 from instance 8c5c80df-59ae-4183-b473-169491735c2f. Sep 07 16:49:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e57c9dc1-c8fc-491d-a192-c1a2f49ad291 tempest-VolumesActionsTest-1128324616 None] Detach volume completed successfully. Sep 07 16:49:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e57c9dc1-c8fc-491d-a192-c1a2f49ad291 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8eae046e-e8f8-4823-9381-80d22257d0b3 tempest-VolumesActionsTest-497140434 None] Acquiring lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-detach_volume" by "detach_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8eae046e-e8f8-4823-9381-80d22257d0b3 tempest-VolumesActionsTest-497140434 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8eae046e-e8f8-4823-9381-80d22257d0b3 tempest-VolumesActionsTest-497140434 None] Volume detach called, but volume not attached. Sep 07 16:49:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8eae046e-e8f8-4823-9381-80d22257d0b3 tempest-VolumesActionsTest-497140434 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Acquiring lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Acquiring lock "cinder-quobyte-22f24ea2-1500-4502-8928-2f36d6e56bf8" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Lock "cinder-quobyte-22f24ea2-1500-4502-8928-2f36d6e56bf8" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[516bdd2d-794a-40a1-802c-ea20cf8958be]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:29 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 Sep 07 16:49:29 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:29 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8" returned: 0 in 0.532s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:29 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8 Sep 07 16:49:29 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:30 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-22f24ea2-1500-4502-8928-2f36d6e56bf8" returned: 0 in 0.352s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Lock "cinder-quobyte-22f24ea2-1500-4502-8928-2f36d6e56bf8" released by "delete_volume" :: held 0.937s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Created reservations ['c4454e4a-946c-43c9-b7ca-0adc8e016fb9', '5bc18ae8-4d94-47cf-8e1a-604c0b0f0871', '28bd7eb5-cad8-4907-8e22-480d37c894a7', 'd2d37c66-b499-4d5c-aaf7-1e62fe54e835'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:30 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:30 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:31 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.577s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:31 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Deleted volume successfully. Sep 07 16:49:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2c8ae412-1af4-431f-8c00-e640990d9dc4 tempest-VolumesActionsTest-497140434 None] Lock "cinder-22f24ea2-1500-4502-8928-2f36d6e56bf8-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:33 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:33 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:33 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.390s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:49:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:49:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "cinder-abcd2632-0ef8-4fee-bffd-9446347d63f1-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-abcd2632-0ef8-4fee-bffd-9446347d63f1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "cinder-quobyte-abcd2632-0ef8-4fee-bffd-9446347d63f1" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-quobyte-abcd2632-0ef8-4fee-bffd-9446347d63f1" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c4b503-ca2c-42b4-91e3-e0491365f812]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:35 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 Sep 07 16:49:35 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:36 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1" returned: 0 in 0.526s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:36 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1 Sep 07 16:49:36 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:36 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-abcd2632-0ef8-4fee-bffd-9446347d63f1" returned: 0 in 0.349s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-quobyte-abcd2632-0ef8-4fee-bffd-9446347d63f1" released by "delete_volume" :: held 0.933s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Created reservations ['f27babb6-3318-4655-8586-d20d36b0a92a', 'ea784bce-9382-4175-a7ee-2045c39c8acd', 'd1d2fffe-2f0f-4e3a-bf6c-97927107db5e', 'b526315c-8499-4824-9491-0f438077cca0'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (69b1e894-0ddf-4e52-a91d-6b0c0c2da07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0929be0-b3a9-433e-b113-e68e2699543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0929be0-b3a9-433e-b113-e68e2699543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-190177721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf2fb36-e647-45b5-8303-5da742cf3fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:37Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50671f38-5eb8-4c80-8b5d-51b5b884e538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50671f38-5eb8-4c80-8b5d-51b5b884e538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b48572-b671-430b-a05f-df5441f9c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b48572-b671-430b-a05f-df5441f9c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cf2fb36-e647-45b5-8303-5da742cf3fc0', 'volume_name': 'volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd2643b-74c8-4626-8447-c5c92308a4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd2643b-74c8-4626-8447-c5c92308a4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67740db-7ab2-4279-b87c-33bfa6410d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:36 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Volume 5cf2fb36-e647-45b5-8303-5da742cf3fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0', 'volume_size': 1} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-190177721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf2fb36-e647-45b5-8303-5da742cf3fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:37Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Creating volume 5cf2fb36-e647-45b5-8303-5da742cf3fc0 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:36 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:36 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 1073741824 Sep 07 16:49:36 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:36 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:36 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:37 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.330s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Deleted volume successfully. Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-09b3d0e9-2872-4804-8d26-5e7a5bee6b74 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-abcd2632-0ef8-4fee-bffd-9446347d63f1-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:37 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 1073741824" returned: 0 in 0.580s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:37 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 Sep 07 16:49:37 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:37 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0" returned: 0 in 0.303s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67740db-7ab2-4279-b87c-33bfa6410d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2fdee3-e8d6-4d19-a1cb-6aca367bbebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:37 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Volume volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 (5cf2fb36-e647-45b5-8303-5da742cf3fc0): created successfully Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2fdee3-e8d6-4d19-a1cb-6aca367bbebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (69b1e894-0ddf-4e52-a91d-6b0c0c2da07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-84544deb-886e-4133-813a-74eaf0178709 tempest-VolumesActionsTest-497140434 None] Created volume successfully. Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "cinder-f455b243-4224-4aaf-b4bd-656f75ea51dd-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-f455b243-4224-4aaf-b4bd-656f75ea51dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "cinder-quobyte-f455b243-4224-4aaf-b4bd-656f75ea51dd" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-quobyte-f455b243-4224-4aaf-b4bd-656f75ea51dd" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be71246-422f-4623-8a0b-bc17fdbede56]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:38 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd Sep 07 16:49:38 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:38 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd" returned: 0 in 0.447s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:38 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd Sep 07 16:49:38 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:38 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f455b243-4224-4aaf-b4bd-656f75ea51dd" returned: 0 in 0.363s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-quobyte-f455b243-4224-4aaf-b4bd-656f75ea51dd" released by "delete_volume" :: held 0.870s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Created reservations ['8828964c-ea8c-4d8b-8ee3-489f978cd984', '4ef33dc4-37d4-422e-bc82-df406f90e95b', '8d46aeea-2a19-49d0-8ba5-b0c8cd0d74a3', 'b9f0bc0a-a977-4823-8218-5192a1a2a361'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-5cf2fb36-e647-45b5-8303-5da742cf3fc0-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-5cf2fb36-e647-45b5-8303-5da742cf3fc0-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:39 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:39 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-quobyte-5cf2fb36-e647-45b5-8303-5da742cf3fc0" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-5cf2fb36-e647-45b5-8303-5da742cf3fc0" acquired by "delete_volume" :: waited 0.036s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ccbf9-2178-4b7f-ab97-01e224652bef]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Flow 'volume_create_manager' (8f1b30e1-f9d3-448b-81a2-28065fa99ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:39 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 Sep 07 16:49:39 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67971ab-fe3b-42e4-af61-aa0c34329203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67971ab-fe3b-42e4-af61-aa0c34329203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-870187607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a373037116c141c485378c964b9bbb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:39Z,use_quota=True,user_id='3f452000d8d44003be7ab84c1b648c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef14263-bec0-4c2a-8289-5e663f86a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef14263-bec0-4c2a-8289-5e663f86a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98491ab-a0e5-4622-820d-ee2def6e0b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:39 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98491ab-a0e5-4622-820d-ee2def6e0b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d69b8f-f9f2-49a3-a92f-3fb35b045ed2', 'volume_name': 'volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2206a3-3485-4478-b509-ed0009ad7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2206a3-3485-4478-b509-ed0009ad7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bdb28c-f3f1-47c4-bc07-5f3703b89279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:39 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Volume d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2', 'volume_size': 1} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-870187607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a373037116c141c485378c964b9bbb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:39Z,use_quota=True,user_id='3f452000d8d44003be7ab84c1b648c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Creating volume d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:39 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.468s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Deleted volume successfully. Sep 07 16:49:39 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 1073741824 Sep 07 16:49:39 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "cinder-bbea8860-53f3-42dd-adf6-fa4f6f299f6a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3fa38744-7dfb-44ee-a2b3-ca19e8033a82 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-f455b243-4224-4aaf-b4bd-656f75ea51dd-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-bbea8860-53f3-42dd-adf6-fa4f6f299f6a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "cinder-quobyte-bbea8860-53f3-42dd-adf6-fa4f6f299f6a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-quobyte-bbea8860-53f3-42dd-adf6-fa4f6f299f6a" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f482a48-26d7-410a-a5b7-ff0b446f9805]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:39 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0" returned: 0 in 0.525s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:39 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a Sep 07 16:49:39 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:39 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0 Sep 07 16:49:39 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:40 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 1073741824" returned: 0 in 0.603s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:40 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5cf2fb36-e647-45b5-8303-5da742cf3fc0" returned: 0 in 0.344s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-5cf2fb36-e647-45b5-8303-5da742cf3fc0" released by "delete_volume" :: held 0.994s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:40 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a" returned: 0 in 0.542s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:40 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a Sep 07 16:49:40 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:40 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 Sep 07 16:49:40 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Created reservations ['815a3d2c-cdfb-434f-ab04-48c0a605fc90', '8f432128-bdac-413c-bb47-0e67bbb28acf', '396f1d36-51cc-4118-85a1-a27c5ebe660c', 'ea7a4442-dd7f-4007-ad6d-3d1d5c7e62d7'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:40 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:40 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:40 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2" returned: 0 in 0.314s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:40 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0bdb28c-f3f1-47c4-bc07-5f3703b89279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b52fab-5650-405e-9b12-69b49b8f15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bbea8860-53f3-42dd-adf6-fa4f6f299f6a" returned: 0 in 0.383s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-quobyte-bbea8860-53f3-42dd-adf6-fa4f6f299f6a" released by "delete_volume" :: held 0.979s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:40 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Volume volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 (d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2): created successfully Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b52fab-5650-405e-9b12-69b49b8f15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Flow 'volume_create_manager' (8f1b30e1-f9d3-448b-81a2-28065fa99ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-05fb7371-b6c2-4e22-9726-80b1c940b5ad req-a8f3e66e-da79-484c-9ecf-0562001864d9 tempest-VolumesGetTestJSON-405326379 None] Created volume successfully. Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Created reservations ['82c9ad32-3267-480e-a6df-68966030df1a', 'fbf0f23e-dbb6-47b2-a47c-5e178d172b8d', 'd1b12bb0-b23a-40e8-b77e-652ab4b89942', '694cc31d-71db-4387-8525-8401eb06d44f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:40 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.333s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Deleted volume successfully. Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e31064d3-2118-4fae-a897-e86761172694 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-5cf2fb36-e647-45b5-8303-5da742cf3fc0-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:40 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:40 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:41 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.270s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Deleted volume successfully. Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-32db2e6b-bf82-4828-b738-dd8bb22797c6 tempest-AttachVolumeNegativeTest-310406525 None] Lock "cinder-bbea8860-53f3-42dd-adf6-fa4f6f299f6a-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (aba15856-9ee3-4abf-9867-438a6950228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54fbefe-a4c7-4107-ab48-bd04ad15deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54fbefe-a4c7-4107-ab48-bd04ad15deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890474227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:42Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc226685-1418-4e65-9d46-d7c829068553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc226685-1418-4e65-9d46-d7c829068553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1437625-801a-49b8-abc6-47461da9517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1437625-801a-49b8-abc6-47461da9517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7', 'volume_name': 'volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c082fc15-3499-4483-9da6-2c78b2f2716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c082fc15-3499-4483-9da6-2c78b2f2716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dab6df-043b-428d-bbb7-0751037e272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:42 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Volume e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7', 'volume_size': 1} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890474227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:42Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Creating volume e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:42 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:42 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 1073741824 Sep 07 16:49:42 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Acquiring lock "cinder-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Lock "cinder-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Acquiring lock "cinder-quobyte-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Lock "cinder-quobyte-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb5a502-69f7-4399-a49c-9d283d9a51d1]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:42 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 Sep 07 16:49:42 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:42 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 1073741824" returned: 0 in 0.557s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:42 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 Sep 07 16:49:42 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:42 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2" returned: 0 in 0.509s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:42 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2 Sep 07 16:49:42 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:43 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7" returned: 0 in 0.358s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13dab6df-043b-428d-bbb7-0751037e272c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6473ec-4938-484b-905b-932e86851616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:43 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Volume volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 (e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7): created successfully Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6473ec-4938-484b-905b-932e86851616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (aba15856-9ee3-4abf-9867-438a6950228a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-73c3e753-af34-4fe9-a13e-24a1de98ca1c tempest-VolumesActionsTest-497140434 None] Created volume successfully. Sep 07 16:49:43 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2" returned: 0 in 0.389s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Lock "cinder-quobyte-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2" released by "delete_volume" :: held 0.965s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.quota [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Created reservations ['f2689df8-a1dd-4e11-9183-cd7588a3e926', 'ea3a3a5c-e1ad-4425-9cfb-43f4e3705e43', '83db3dc0-b1c0-4684-8c06-db8a8284ad3d', '74bf38a8-1c99-47a0-9093-833138c0bc94'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:43 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:43 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:43 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.manager [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Deleted volume successfully. Sep 07 16:49:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-4f18f274-93ec-4b88-8c8e-d1856a318a7f req-8318f069-c358-4bff-87f2-d1734149d1a5 tempest-VolumesGetTestJSON-405326379 None] Lock "cinder-d7d69b8f-f9f2-49a3-a92f-3fb35b045ed2-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=111,cinder:SELECT=124,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-quobyte-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb9eda-a7d2-402f-b532-9a827d2e076b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:44 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 Sep 07 16:49:44 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:44 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7" returned: 0 in 0.404s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:44 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7 Sep 07 16:49:44 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:45 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7" released by "delete_volume" :: held 0.756s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Created reservations ['e784040f-c572-4f1b-a33e-02daeb83bac5', '9daa3fa3-a4b1-4c8f-a09c-1a2318e74bf4', 'e0193f91-8faf-4bcb-a155-9fa7765a86d6', 'dc49e1fb-73ad-4468-89fe-957dda7c63d3'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:45 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:45 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:45 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.364s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Deleted volume successfully. Sep 07 16:49:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c2dcca71-01bd-44f6-9f1e-f5c38a64c196 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-e4f39fbc-2b9d-4c45-87ae-ad85f3804aa7-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (679d808b-a882-4dee-b247-e4feda1de0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7be9949-9240-4b01-85b5-6480848cbd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7be9949-9240-4b01-85b5-6480848cbd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-247134739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f746d870-663c-42c2-baed-f0624642b3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:46Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd429d8-370c-4258-ae83-78767fd0120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd429d8-370c-4258-ae83-78767fd0120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608db713-98f2-4f44-ac84-b67eeeff0a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608db713-98f2-4f44-ac84-b67eeeff0a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f746d870-663c-42c2-baed-f0624642b3e6', 'volume_name': 'volume-f746d870-663c-42c2-baed-f0624642b3e6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa78bd04-f46c-424b-ae59-8afe689d5710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa78bd04-f46c-424b-ae59-8afe689d5710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94845535-7e4c-4b08-ba1a-f040e855a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:46 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Volume f746d870-663c-42c2-baed-f0624642b3e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f746d870-663c-42c2-baed-f0624642b3e6', 'volume_size': 1} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-247134739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f746d870-663c-42c2-baed-f0624642b3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:46Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Creating volume f746d870-663c-42c2-baed-f0624642b3e6 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:46 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:46 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 1073741824 Sep 07 16:49:46 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:46 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 1073741824" returned: 0 in 0.526s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:46 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 Sep 07 16:49:46 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:47 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6" returned: 0 in 0.374s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94845535-7e4c-4b08-ba1a-f040e855a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f746d870-663c-42c2-baed-f0624642b3e6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f7898b-3a06-4fbb-9a3e-cb7ca28f23a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:47 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Volume volume-f746d870-663c-42c2-baed-f0624642b3e6 (f746d870-663c-42c2-baed-f0624642b3e6): created successfully Sep 07 16:49:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f7898b-3a06-4fbb-9a3e-cb7ca28f23a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (679d808b-a882-4dee-b247-e4feda1de0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:47 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e0425345-c19d-4b0e-927c-85b8f5a31bb8 tempest-VolumesActionsTest-497140434 None] Created volume successfully. Sep 07 16:49:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-f746d870-663c-42c2-baed-f0624642b3e6-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Lock "cinder-f746d870-663c-42c2-baed-f0624642b3e6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:48 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=112,cinder:UPDATE=144,cinder:DELETE=10,cinder:INSERT=26 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:49:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-quobyte-f746d870-663c-42c2-baed-f0624642b3e6" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-f746d870-663c-42c2-baed-f0624642b3e6" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:48 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba22473d-1b09-464b-bad9-d63ade82d571]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:48 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 Sep 07 16:49:48 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:49 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6" returned: 0 in 0.639s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:49 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6 Sep 07 16:49:49 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:49 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f746d870-663c-42c2-baed-f0624642b3e6" returned: 0 in 0.376s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-f746d870-663c-42c2-baed-f0624642b3e6" released by "delete_volume" :: held 1.096s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Created reservations ['e1a7b3d6-46a1-4c24-993c-68fafa5afc7f', '5647682e-f649-4e36-8d0f-198d878e3354', '37d88f97-4f5e-4b65-8171-71f50edd5948', '36c1c462-fb22-4eed-8b2f-f9865389a902'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:49 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:49 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:50 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.306s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:50 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Deleted volume successfully. Sep 07 16:49:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c16578b0-cd9b-46bb-9d53-a330dffa8c6c tempest-VolumesActionsTest-1128324616 None] Lock "cinder-f746d870-663c-42c2-baed-f0624642b3e6-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (da0d5463-246b-4f5f-9cb8-c12d3b8b63f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb71ae5-e00a-419b-8bcf-959ad633377d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d8954a06-ab71-4e80-a6c4-1247e6a0bcbf tempest-GroupsTest-641084236 None] Group tempest-Group1-293735028: creating Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb71ae5-e00a-419b-8bcf-959ad633377d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077537169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88a304a-26e3-4a42-b84b-94b3bf2981e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:51Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4adfd29-035f-4f15-8562-e10d76ff4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4adfd29-035f-4f15-8562-e10d76ff4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122cd3ec-24ce-4db4-92fd-7e5ac8168b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122cd3ec-24ce-4db4-92fd-7e5ac8168b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88a304a-26e3-4a42-b84b-94b3bf2981e9', 'volume_name': 'volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fffef3-d01a-445e-afb1-b7c6293470d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fffef3-d01a-445e-afb1-b7c6293470d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb963e64-663a-4616-837d-7cf3b7486b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:51 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Volume e88a304a-26e3-4a42-b84b-94b3bf2981e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9', 'volume_size': 1} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077537169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88a304a-26e3-4a42-b84b-94b3bf2981e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:51Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Creating volume e88a304a-26e3-4a42-b84b-94b3bf2981e9 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:51 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:51 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 1073741824 Sep 07 16:49:51 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d8954a06-ab71-4e80-a6c4-1247e6a0bcbf tempest-GroupsTest-641084236 None] Group tempest-Group1-293735028: created successfully Sep 07 16:49:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d8954a06-ab71-4e80-a6c4-1247e6a0bcbf tempest-GroupsTest-641084236 None] Create group completed successfully. Sep 07 16:49:52 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 1073741824" returned: 0 in 0.688s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:52 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 Sep 07 16:49:52 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:52 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9" returned: 0 in 0.341s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb963e64-663a-4616-837d-7cf3b7486b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5c1b8d-d779-4671-8ec5-4fe8c40d5eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:52 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Volume volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 (e88a304a-26e3-4a42-b84b-94b3bf2981e9): created successfully Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5c1b8d-d779-4671-8ec5-4fe8c40d5eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (da0d5463-246b-4f5f-9cb8-c12d3b8b63f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-dadff936-f8b1-4d35-b140-e0e11b85c022 tempest-VolumesActionsTest-497140434 None] Created volume successfully. Sep 07 16:49:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e3562c77-0cf9-47b4-9260-c1cccff3770f tempest-GroupsTest-641084236 None] Group tempest-Group2-1152258059: creating Sep 07 16:49:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e3562c77-0cf9-47b4-9260-c1cccff3770f tempest-GroupsTest-641084236 None] Group tempest-Group2-1152258059: created successfully Sep 07 16:49:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e3562c77-0cf9-47b4-9260-c1cccff3770f tempest-GroupsTest-641084236 None] Create group completed successfully. Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3783f8c0-7882-4db9-870e-af524c60f957 tempest-BackendsCapabilitiesAdminTestsJSON-609647289 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.566562652588, 'free_capacity_gb': 1773.566562652588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87492) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bcc0485a-9298-4f06-9349-def4aba136a3 tempest-BackendsCapabilitiesAdminTestsJSON-609647289 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.566562652588, 'free_capacity_gb': 1773.566562652588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87492) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-e88a304a-26e3-4a42-b84b-94b3bf2981e9-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-e88a304a-26e3-4a42-b84b-94b3bf2981e9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "cinder-quobyte-e88a304a-26e3-4a42-b84b-94b3bf2981e9" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-e88a304a-26e3-4a42-b84b-94b3bf2981e9" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5add2e3f-546c-45a1-b147-3943cbc48a31]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:54 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 Sep 07 16:49:54 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:54 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9" returned: 0 in 0.612s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:54 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9 Sep 07 16:49:54 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:54 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e88a304a-26e3-4a42-b84b-94b3bf2981e9" returned: 0 in 0.484s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-quobyte-e88a304a-26e3-4a42-b84b-94b3bf2981e9" released by "delete_volume" :: held 1.181s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Flow 'volume_create_manager' (29322144-8e65-40ec-809e-ac309e5bb83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c07a6eb-2bee-4b7b-a9a8-af9310519e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c07a6eb-2bee-4b7b-a9a8-af9310519e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-31370337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3aae4a4-715b-48bd-b442-ffc9354187e7,host='devstack@QuobyteHD#QuobyteHD',id=509c401b-11c5-4be8-b7e6-8e28cb62caf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5230d079d42497f8e22f29d2ca1692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:55Z,use_quota=True,user_id='198a90a493d9453185be3bdafba39d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6699540-af36-44ba-b32b-aab5f0f1bcf9),volume_type_id=e6699540-af36-44ba-b32b-aab5f0f1bcf9)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8ae0ff-09d0-4816-a9a3-8881b8ca7d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8ae0ff-09d0-4816-a9a3-8881b8ca7d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b01d5d4-917f-4240-9d47-c85cdec3d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b01d5d4-917f-4240-9d47-c85cdec3d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509c401b-11c5-4be8-b7e6-8e28cb62caf3', 'volume_name': 'volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e5bcc3-95e5-42be-a75a-8e7a2e3a0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e5bcc3-95e5-42be-a75a-8e7a2e3a0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ded2cc6-0d65-4afe-81ae-c17d8085decf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:55 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Volume 509c401b-11c5-4be8-b7e6-8e28cb62caf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3', 'volume_size': 1} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3aae4a4-715b-48bd-b442-ffc9354187e7,created_at=2026-09-07T14:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-31370337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3aae4a4-715b-48bd-b442-ffc9354187e7,host='devstack@QuobyteHD#QuobyteHD',id=509c401b-11c5-4be8-b7e6-8e28cb62caf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5230d079d42497f8e22f29d2ca1692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:55Z,use_quota=True,user_id='198a90a493d9453185be3bdafba39d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6699540-af36-44ba-b32b-aab5f0f1bcf9),volume_type_id=e6699540-af36-44ba-b32b-aab5f0f1bcf9)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Creating volume 509c401b-11c5-4be8-b7e6-8e28cb62caf3 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:55 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:55 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 1073741824 Sep 07 16:49:55 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Created reservations ['73891d68-4701-44f2-808e-d34c600f732d', '3e0144e6-5729-4ff4-a102-a209814b00c6', 'e4f77765-fd09-466b-87fc-97dc47025a9e', '18f99c38-6f43-46bf-a912-c23ecd430fac'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:55 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:55 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:55 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 1073741824" returned: 0 in 0.713s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:55 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.572s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:55 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:55 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 Sep 07 16:49:55 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Deleted volume successfully. Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1815217a-4d6a-45bb-acf6-c3e655589dc4 tempest-VolumesActionsTest-1128324616 None] Lock "cinder-e88a304a-26e3-4a42-b84b-94b3bf2981e9-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:56 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3" returned: 0 in 0.497s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ded2cc6-0d65-4afe-81ae-c17d8085decf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a46d476-d7a2-447a-a132-65cc1098c0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:56 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Volume volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 (509c401b-11c5-4be8-b7e6-8e28cb62caf3): created successfully Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a46d476-d7a2-447a-a132-65cc1098c0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Flow 'volume_create_manager' (29322144-8e65-40ec-809e-ac309e5bb83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:56 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-20836435-d2bc-472c-a1e6-bb9da937e892 tempest-GroupsTest-641084236 None] Created volume successfully. Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (2ed638b8-bb8c-4bfe-bd84-56342a5d9f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f015255-7631-4df8-8784-b280b046ff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f015255-7631-4df8-8784-b280b046ff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718155536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b33fd1d-cc5b-47dd-a599-492d11218957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:57Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ac278e-3bb1-4029-ba91-f5aa11f33dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ac278e-3bb1-4029-ba91-f5aa11f33dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974729b4-2f6c-4e65-9261-ec5e07837f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974729b4-2f6c-4e65-9261-ec5e07837f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b33fd1d-cc5b-47dd-a599-492d11218957', 'volume_name': 'volume-2b33fd1d-cc5b-47dd-a599-492d11218957', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4656b31-9401-40fe-b892-8ba63bb2f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4656b31-9401-40fe-b892-8ba63bb2f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69705ab-6e33-4a12-b0db-86324516d0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:57 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Volume 2b33fd1d-cc5b-47dd-a599-492d11218957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b33fd1d-cc5b-47dd-a599-492d11218957', 'volume_size': 1} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1718155536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b33fd1d-cc5b-47dd-a599-492d11218957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba5e3f47d8e4c258ce608ab617b30d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:49:57Z,use_quota=True,user_id='f8c6efc1dbbd4e089219e19525c7ec7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Creating volume 2b33fd1d-cc5b-47dd-a599-492d11218957 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:49:57 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:57 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 1073741824 Sep 07 16:49:57 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:57 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 1073741824" returned: 0 in 0.590s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:57 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 Sep 07 16:49:57 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:58 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957" returned: 0 in 0.288s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69705ab-6e33-4a12-b0db-86324516d0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b33fd1d-cc5b-47dd-a599-492d11218957', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9891335e-a206-46cb-a541-11a9f468ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:49:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Volume volume-2b33fd1d-cc5b-47dd-a599-492d11218957 (2b33fd1d-cc5b-47dd-a599-492d11218957): created successfully Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9891335e-a206-46cb-a541-11a9f468ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Flow 'volume_create_manager' (2ed638b8-bb8c-4bfe-bd84-56342a5d9f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:49:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c0f25251-375c-456c-b767-dec9200e4b43 tempest-VolumesActionsTest-497140434 None] Created volume successfully. Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Acquiring lock "cinder-quobyte-509c401b-11c5-4be8-b7e6-8e28cb62caf3" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Lock "cinder-quobyte-509c401b-11c5-4be8-b7e6-8e28cb62caf3" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b98a1-600f-4aa0-b189-eac74a22c402]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:58 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 Sep 07 16:49:58 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:58 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3" returned: 0 in 0.499s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:59 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3 Sep 07 16:49:59 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:59 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-509c401b-11c5-4be8-b7e6-8e28cb62caf3" returned: 0 in 0.323s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Lock "cinder-quobyte-509c401b-11c5-4be8-b7e6-8e28cb62caf3" released by "delete_volume" :: held 0.884s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Created reservations ['4d9bade3-ac92-4b3d-843b-4072ab37e368'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:59 devstack cinder-volume[87492]: WARNING cinder.quota [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-174605562 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-174605562, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:49:59 devstack cinder-volume[87492]: WARNING cinder.quota [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-174605562 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-174605562, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Created reservations ['69d9c4fc-f5f3-4731-b25a-4370cbaa988d', '7492550b-6231-4a74-951d-c49f814c98cf', '59252dd3-8954-4fc7-8812-93b142055e92', 'afaffb5b-4aaa-4a8e-9a3a-89e431720dcd'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:59 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:59 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Created reservations ['f633484f-b0ee-4105-a062-24e13f34922e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:49:59 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:59 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6a7e017e-6db3-4a52-981f-236f50e22bbd tempest-GroupsTest-641084236 None] Delete group completed successfully. Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:49:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:59 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:49:59 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Acquiring lock "cinder-2b33fd1d-cc5b-47dd-a599-492d11218957-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Lock "cinder-2b33fd1d-cc5b-47dd-a599-492d11218957-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Acquiring lock "cinder-quobyte-2b33fd1d-cc5b-47dd-a599-492d11218957" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Lock "cinder-quobyte-2b33fd1d-cc5b-47dd-a599-492d11218957" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db1c268-9351-4fc4-81f7-f5a80d14cf00]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:00 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.362s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9de57350-21df-4618-9374-5e053a68b5ba tempest-GroupsTest-641084236 None] Delete group completed successfully. Sep 07 16:50:00 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 Sep 07 16:50:00 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:00 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957" returned: 0 in 0.417s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:00 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957 Sep 07 16:50:00 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:00 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2b33fd1d-cc5b-47dd-a599-492d11218957" returned: 0 in 0.294s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Lock "cinder-quobyte-2b33fd1d-cc5b-47dd-a599-492d11218957" released by "delete_volume" :: held 0.778s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Created reservations ['3f80f552-b2bc-4415-8da0-c48af9e4bdfe', '71ce6aad-f983-4cf8-a2a8-09e19c73d9a0', '65d17706-2783-49ec-beed-45883055009c', '7df65607-3fe9-4387-bcbc-90f9a8dffbe6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:01 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:01 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:01 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.301s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Deleted volume successfully. Sep 07 16:50:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6ac9ef39-3b29-4796-bfd9-af4f873194de tempest-VolumesActionsTest-497140434 None] Lock "cinder-2b33fd1d-cc5b-47dd-a599-492d11218957-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c9497fb2-d6c5-4893-96c5-06607475481e tempest-GroupsTest-641084236 None] Group tempest-GroupsTest-Group-1804199171: creating Sep 07 16:50:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c9497fb2-d6c5-4893-96c5-06607475481e tempest-GroupsTest-641084236 None] Group tempest-GroupsTest-Group-1804199171: created successfully Sep 07 16:50:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c9497fb2-d6c5-4893-96c5-06607475481e tempest-GroupsTest-641084236 None] Create group completed successfully. Sep 07 16:50:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0a335a54-78c1-4d76-bae4-06944d18722d tempest-GroupSnapshotsTest-331254160 None] Group tempest-GroupSnapshotsTest-Group-873717354: creating Sep 07 16:50:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0a335a54-78c1-4d76-bae4-06944d18722d tempest-GroupSnapshotsTest-331254160 None] Group tempest-GroupSnapshotsTest-Group-873717354: created successfully Sep 07 16:50:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0a335a54-78c1-4d76-bae4-06944d18722d tempest-GroupSnapshotsTest-331254160 None] Create group completed successfully. Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Flow 'volume_create_manager' (a3cf3ca2-f3db-4dc0-bfe9-405bda3bd908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a5ddd2-bd4e-497b-b2eb-05a7a26d6e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a5ddd2-bd4e-497b-b2eb-05a7a26d6e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000514806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9cd38cb0-7611-45eb-a9a8-c3cdf8e25d2f,host='devstack@QuobyteHD#QuobyteHD',id=5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5230d079d42497f8e22f29d2ca1692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:04Z,use_quota=True,user_id='198a90a493d9453185be3bdafba39d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5861f269-10ee-443f-a9f0-d7afeaf25765),volume_type_id=5861f269-10ee-443f-a9f0-d7afeaf25765)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edd4f91-2732-4532-98b2-91d4a1199da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edd4f91-2732-4532-98b2-91d4a1199da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a0890-9229-4c82-bf3d-13d266cff192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a0890-9229-4c82-bf3d-13d266cff192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a', 'volume_name': 'volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cd4a3e-ce65-4fd0-bdd8-5443ad12a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cd4a3e-ce65-4fd0-bdd8-5443ad12a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf9b255-5402-4726-93d0-1091cc434601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Volume 5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a', 'volume_size': 1} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9cd38cb0-7611-45eb-a9a8-c3cdf8e25d2f,created_at=2026-09-07T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000514806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9cd38cb0-7611-45eb-a9a8-c3cdf8e25d2f,host='devstack@QuobyteHD#QuobyteHD',id=5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5230d079d42497f8e22f29d2ca1692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:04Z,use_quota=True,user_id='198a90a493d9453185be3bdafba39d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5861f269-10ee-443f-a9f0-d7afeaf25765),volume_type_id=5861f269-10ee-443f-a9f0-d7afeaf25765)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Creating volume 5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:03 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:03 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a 1073741824 Sep 07 16:50:03 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:04 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a 1073741824" returned: 0 in 0.661s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:04 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a Sep 07 16:50:04 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (85a8df3b-b9d9-4f4f-9128-a149fa4ede8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f21a37-69da-43f1-bdb1-a51a50c8cb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93f21a37-69da-43f1-bdb1-a51a50c8cb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061362449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ca7357b-38f9-4755-8110-2bb084127f58,host='devstack@QuobyteHD#QuobyteHD',id=a74b8681-b3e3-4f31-907a-862b05f2f93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:04Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc678c2-4f63-4efe-89ed-e7d240a72ab3),volume_type_id=7fc678c2-4f63-4efe-89ed-e7d240a72ab3)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc2c654-b50c-4e0d-b40b-816cc46ba7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc2c654-b50c-4e0d-b40b-816cc46ba7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c04512-8461-49af-bbee-f41df51436f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c04512-8461-49af-bbee-f41df51436f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74b8681-b3e3-4f31-907a-862b05f2f93d', 'volume_name': 'volume-a74b8681-b3e3-4f31-907a-862b05f2f93d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d9947e-9ae8-4acd-8998-60a3ee969606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d9947e-9ae8-4acd-8998-60a3ee969606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc3d3dc-50e9-4c48-b7f0-38f1ac1d431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Volume a74b8681-b3e3-4f31-907a-862b05f2f93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74b8681-b3e3-4f31-907a-862b05f2f93d', 'volume_size': 1} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:04 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a" returned: 0 in 0.270s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ca7357b-38f9-4755-8110-2bb084127f58,created_at=2026-09-07T14:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1061362449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ca7357b-38f9-4755-8110-2bb084127f58,host='devstack@QuobyteHD#QuobyteHD',id=a74b8681-b3e3-4f31-907a-862b05f2f93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:04Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc678c2-4f63-4efe-89ed-e7d240a72ab3),volume_type_id=7fc678c2-4f63-4efe-89ed-e7d240a72ab3)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Creating volume a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:04 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:04 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d 1073741824 Sep 07 16:50:04 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf9b255-5402-4726-93d0-1091cc434601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fde6253-75a4-4782-a7e6-a9f1ad14807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Volume volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a (5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a): created successfully Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fde6253-75a4-4782-a7e6-a9f1ad14807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Flow 'volume_create_manager' (a3cf3ca2-f3db-4dc0-bfe9-405bda3bd908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0707bf15-0a77-48cf-9ad8-ae4ccf32e839 tempest-GroupsTest-641084236 None] Created volume successfully. Sep 07 16:50:05 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d 1073741824" returned: 0 in 0.597s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:05 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d Sep 07 16:50:05 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:05 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc3d3dc-50e9-4c48-b7f0-38f1ac1d431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74b8681-b3e3-4f31-907a-862b05f2f93d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5a8919-8104-427e-bd3c-ab306bda3cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:05 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Volume volume-a74b8681-b3e3-4f31-907a-862b05f2f93d (a74b8681-b3e3-4f31-907a-862b05f2f93d): created successfully Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5a8919-8104-427e-bd3c-ab306bda3cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (85a8df3b-b9d9-4f4f-9128-a149fa4ede8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-076f3cb5-ba95-42e8-95e5-f9e1d51caca6 tempest-GroupSnapshotsTest-331254160 None] Created volume successfully. Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Flow 'volume_create_manager' (b12819b4-689c-46cc-922c-ae17b32bd7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57391f99-ad98-4e53-97f1-62ae0a16c2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57391f99-ad98-4e53-97f1-62ae0a16c2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1764870056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9cd38cb0-7611-45eb-a9a8-c3cdf8e25d2f,host='devstack@QuobyteHD#QuobyteHD',id=69ebe24e-9adc-4e47-83dc-1cc2f2f74c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5230d079d42497f8e22f29d2ca1692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:07Z,use_quota=True,user_id='198a90a493d9453185be3bdafba39d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5861f269-10ee-443f-a9f0-d7afeaf25765),volume_type_id=5861f269-10ee-443f-a9f0-d7afeaf25765)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e37f73d-95b3-45f0-9649-231edb443626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e37f73d-95b3-45f0-9649-231edb443626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581f61ed-cd37-4d79-a76b-73c4bc94f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581f61ed-cd37-4d79-a76b-73c4bc94f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ebe24e-9adc-4e47-83dc-1cc2f2f74c48', 'volume_name': 'volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff41565-0197-4048-8c54-c7f0de1750e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff41565-0197-4048-8c54-c7f0de1750e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e0839c-1859-4ae0-bf51-eaec2bc9c5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:06 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Volume 69ebe24e-9adc-4e47-83dc-1cc2f2f74c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48', 'volume_size': 1} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9cd38cb0-7611-45eb-a9a8-c3cdf8e25d2f,created_at=2026-09-07T14:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1764870056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9cd38cb0-7611-45eb-a9a8-c3cdf8e25d2f,host='devstack@QuobyteHD#QuobyteHD',id=69ebe24e-9adc-4e47-83dc-1cc2f2f74c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5230d079d42497f8e22f29d2ca1692a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:07Z,use_quota=True,user_id='198a90a493d9453185be3bdafba39d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5861f269-10ee-443f-a9f0-d7afeaf25765),volume_type_id=5861f269-10ee-443f-a9f0-d7afeaf25765)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Creating volume 69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:06 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:06 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 1073741824 Sep 07 16:50:06 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:07 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] GroupSnapshot b5ef6468-5292-468b-8058-a8614395180e: creating. Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Group snapshot b5ef6468-5292-468b-8058-a8614395180e: creating. {{(pid=87492) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:07 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 1073741824" returned: 0 in 0.671s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:07 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 Sep 07 16:50:07 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:07 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.467s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e0839c-1859-4ae0-bf51-eaec2bc9c5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba807d6-e7e6-4eee-8e8f-067efb4a426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Creating offline snapshot 91dcc0b9-e697-474c-af88-e65e334991e2 of volume a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:50:08 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Volume volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 (69ebe24e-9adc-4e47-83dc-1cc2f2f74c48): created successfully Sep 07 16:50:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba807d6-e7e6-4eee-8e8f-067efb4a426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Flow 'volume_create_manager' (b12819b4-689c-46cc-922c-ae17b32bd7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6f93bf-47b0-41a7-8b22-5766e458e59c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:08 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d020a9d7-715d-4044-9c8a-67ad0afe6a73 tempest-GroupsTest-641084236 None] Created volume successfully. Sep 07 16:50:08 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d Sep 07 16:50:08 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:08 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d" returned: 0 in 0.488s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:08 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 1G Sep 07 16:50:08 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:09 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 1G" returned: 0 in 0.522s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a74b8681-b3e3-4f31-907a-862b05f2f93d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:09 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a74b8681-b3e3-4f31-907a-862b05f2f93d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 Sep 07 16:50:09 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:09 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a74b8681-b3e3-4f31-907a-862b05f2f93d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:09 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:50:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fe7dfc7d-1d9f-404e-9453-14713781d381 tempest-GroupsTest-641084236 None] Update group completed successfully. Sep 07 16:50:09 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 Sep 07 16:50:09 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:09 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2" returned: 0 in 0.367s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:09 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.info Sep 07 16:50:09 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:10 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.info" returned: 0 in 0.315s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:10 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:50:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:10 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.info Sep 07 16:50:10 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:10 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.info" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1992db56-2081-4296-91d4-e531f191cad3 tempest-GroupSnapshotsTest-331254160 None] group_snapshot b5ef6468-5292-468b-8058-a8614395180e: created successfully Sep 07 16:50:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e211c41c-2076-4a49-b848-0dd300fc9bc5 tempest-GroupsTest-641084236 None] Update group completed successfully. Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-91dcc0b9-e697-474c-af88-e65e334991e2-7e9bb616-7405-4635-8022-c837a705f4cc" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-91dcc0b9-e697-474c-af88-e65e334991e2-7e9bb616-7405-4635-8022-c837a705f4cc" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Creating volume 7e9bb616-7405-4635-8022-c837a705f4cc from snapshot 91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-7e9bb616-7405-4635-8022-c837a705f4cc" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-7e9bb616-7405-4635-8022-c837a705f4cc" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] snapshot: 91dcc0b9-e697-474c-af88-e65e334991e2, volume: 7e9bb616-7405-4635-8022-c837a705f4cc, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abf74ef-d717-4c85-a677-0c05f2d6db1b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:12 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 Sep 07 16:50:12 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:13 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2" returned: 0 in 0.508s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a74b8681-b3e3-4f31-907a-862b05f2f93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff27e08-84e7-4cf8-97a7-90d9e469fbec]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Flow 'volume_create_manager' (d232f947-96e3-4d25-a6c5-c67761ac7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671ea635-cc46-4b05-8d9e-7abc0ea28e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671ea635-cc46-4b05-8d9e-7abc0ea28e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1126249696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3d724b-3cd4-431c-8396-48a0889afade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420085f237140e1a347c7d5070ffdee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:13Z,use_quota=True,user_id='0807019d59ce4ceb87e86cf31a90dfb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a59ff73-4f82-4e55-8d9a-ba498b7656ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a59ff73-4f82-4e55-8d9a-ba498b7656ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd09e60-0ae1-4b0a-a47b-e9a0fca3f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:50:13 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d Sep 07 16:50:13 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Acquiring lock "cinder-quobyte-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Lock "cinder-quobyte-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ee1344-2d57-4bd3-b1af-f82c4acf8271]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:13 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d" returned: 0 in 0.475s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:13 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc Sep 07 16:50:13 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:13 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a Sep 07 16:50:13 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:13 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a" returned: 0 in 0.513s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:14 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a Sep 07 16:50:14 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd09e60-0ae1-4b0a-a47b-e9a0fca3f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb3d724b-3cd4-431c-8396-48a0889afade', 'volume_name': 'volume-fb3d724b-3cd4-431c-8396-48a0889afade', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5bf58c-e56e-4e10-8f73-9f822acbf931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5bf58c-e56e-4e10-8f73-9f822acbf931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61947244-a9d7-4283-ac79-10cdd590a630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Volume fb3d724b-3cd4-431c-8396-48a0889afade: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb3d724b-3cd4-431c-8396-48a0889afade', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Trying to clone fb3d724b-3cd4-431c-8396-48a0889afade from image cd35955c-2cfe-436b-a709-f0de1afb8856 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:50:14 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a" returned: 0 in 0.409s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Lock "cinder-quobyte-5d8c15f5-22cf-4d8c-ba7b-3babf28e0c8a" released by "delete_volume" :: held 1.069s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Acquiring lock "cinder-quobyte-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Lock "cinder-quobyte-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48" acquired by "delete_volume" :: waited 0.061s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb96e2a-f283-47ae-9a4a-e13342dc57d5]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:50:14 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Image download 20.69 MB at 20.69 MB/s Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc407904-7eb6-4fa9-a56d-11f3b66a157e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:15 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 Sep 07 16:50:15 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:15 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD Sep 07 16:50:15 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:15 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48" returned: 0 in 1.095s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:15 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48 Sep 07 16:50:15 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:16 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD" returned: 0 in 1.126s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 is fetched for user 0807019d59ce4ceb87e86cf31a90dfb5. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a7b9bd-504e-41ac-b9b5-8c09d24b2b69]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:16 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48" returned: 0 in 0.812s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Lock "cinder-quobyte-69ebe24e-9adc-4e47-83dc-1cc2f2f74c48" released by "delete_volume" :: held 2.047s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:16 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD Sep 07 16:50:16 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Created reservations ['c7de40ea-3bf9-4fbb-a1e9-f1a904a1a349'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:16 devstack cinder-volume[87492]: WARNING cinder.quota [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1303650051 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1303650051, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:16 devstack cinder-volume[87492]: WARNING cinder.quota [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1303650051 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1303650051, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:16 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Created reservations ['f7601070-94e3-4545-ae82-7b04ec28fd8c', '18af5497-8025-413d-bdf7-adde97c66cc1', '3abee347-302a-4d80-b830-f455289d4034', 'f7107bcc-27ea-4ad9-935f-9938ae025ace'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Created reservations ['0b81a56c-2e87-46ec-9da9-fc39a937244f', 'f128190c-7e39-4a46-ae36-24778466f218', 'd563b52e-d26c-40f9-8bd9-401771d3749d', '551993b4-b833-4515-9004-e6e344807d0e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:17 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:17 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:18 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.540s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:18 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9f0d7c25-1d49-41db-a7e4-405a38e4a870 tempest-GroupsTest-641084236 None] Delete group completed successfully. Sep 07 16:50:19 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc" returned: 0 in 6.379s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:19 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:50:19 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Converted 1024.00 MB image at 160.49 MB/s Sep 07 16:50:19 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:50:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:19 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc Sep 07 16:50:19 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:20 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc" returned: 0 in 0.305s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-7e9bb616-7405-4635-8022-c837a705f4cc" released by "_copy_volume_from_snapshot" :: held 7.785s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-91dcc0b9-e697-474c-af88-e65e334991e2-7e9bb616-7405-4635-8022-c837a705f4cc" released by "_create_volume_from_snapshot" :: held 7.874s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.895s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.339s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1126249696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3d724b-3cd4-431c-8396-48a0889afade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a420085f237140e1a347c7d5070ffdee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:13Z,use_quota=True,user_id='0807019d59ce4ceb87e86cf31a90dfb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Creating volume fb3d724b-3cd4-431c-8396-48a0889afade {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:20 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:20 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade 1073741824 Sep 07 16:50:20 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:20 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-890e4cfa-9877-40aa-b782-dc0e3378cce8 tempest-GroupSnapshotsTest-331254160 None] Create group from source-snapshot-b5ef6468-5292-468b-8058-a8614395180e completed successfully. Sep 07 16:50:20 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade 1073741824" returned: 0 in 0.502s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:20 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade Sep 07 16:50:20 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:21 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade" returned: 0 in 0.322s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Attempting download of cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume fb3d724b-3cd4-431c-8396-48a0889afade. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[246c869a-bdce-4516-860d-e23875108a86]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_emclqz6z {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:21 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_emclqz6z Sep 07 16:50:21 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:21 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_emclqz6z" returned: 0 in 0.423s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_emclqz6z {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:21 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_emclqz6z Sep 07 16:50:21 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-7e9bb616-7405-4635-8022-c837a705f4cc" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-7e9bb616-7405-4635-8022-c837a705f4cc" acquired by "delete_volume" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7130ce-b855-4568-8fd5-7b0e29819fdd]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:22 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_emclqz6z" returned: 1 in 0.525s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_emclqz6z' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aef165-e276-403d-ab8c-5e19f4a7c23c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:22 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc Sep 07 16:50:22 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:22 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD Sep 07 16:50:22 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:22 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc" returned: 0 in 0.470s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:22 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc Sep 07 16:50:22 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:22 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] cd35955c-2cfe-436b-a709-f0de1afb8856 was qcow2, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:22 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade Sep 07 16:50:22 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:22 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7e9bb616-7405-4635-8022-c837a705f4cc" returned: 0 in 0.298s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-7e9bb616-7405-4635-8022-c837a705f4cc" released by "delete_volume" :: held 0.830s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['6bc76be9-c8d8-4ec8-bbea-3177dfe1d65d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:23 devstack cinder-volume[87492]: WARNING cinder.quota [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1040002425 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1040002425, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:23 devstack cinder-volume[87492]: WARNING cinder.quota [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1040002425 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1040002425, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['88946bb1-9298-4760-9ef9-c3646554aad8', '41e51368-fa5a-40bf-b5d9-30a5a4877e51', 'beb9c5f4-9cc7-4da8-a875-b997c7cfa7b4', 'cb73a7ad-4c4d-4307-b203-d06546cc323c'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:23 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:23 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] group_snapshot b5ef6468-5292-468b-8058-a8614395180e: deleting Sep 07 16:50:23 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] group_snapshot b5ef6468-5292-468b-8058-a8614395180e: deleting {{(pid=87492) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.352s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7dce51e4-9ddd-4146-acb5-4416e2063c04 tempest-GroupSnapshotsTest-331254160 None] Delete group completed successfully. Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-a74b8681-b3e3-4f31-907a-862b05f2f93d" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-a74b8681-b3e3-4f31-907a-862b05f2f93d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-91dcc0b9-e697-474c-af88-e65e334991e2" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-91dcc0b9-e697-474c-af88-e65e334991e2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Deleting offline snapshot 91dcc0b9-e697-474c-af88-e65e334991e2 of volume a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] snapshot_file for this snap is: volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4343ef-9ceb-4811-acde-a173e2b4f6c4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:23 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 Sep 07 16:50:23 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:24 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2" returned: 0 in 0.496s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a74b8681-b3e3-4f31-907a-862b05f2f93d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:50:24 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a86576-57b0-4dec-876c-79d7cb8dc8e0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:24 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d Sep 07 16:50:24 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:25 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d" returned: 0 in 0.691s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:25 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 Sep 07 16:50:25 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:25 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade" returned: 0 in 2.568s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_83h8tg_cdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:50:25 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Converted 112.00 MB image at 43.59 MB/s Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:25 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade 1G Sep 07 16:50:25 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:25 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2" returned: 0 in 0.513s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:25 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2 Sep 07 16:50:25 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Flow 'volume_create_manager' (d8dcc11d-f21c-4b33-b056-54066b7ae624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8f1cb2-d096-4e56-9034-b4658e6892c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8f1cb2-d096-4e56-9034-b4658e6892c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1366368937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501fc744-9049-44c3-bea4-f4827b02faca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5cd450c3404c3ebe60878a43abb105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:26Z,use_quota=True,user_id='b41fcaafa2f24018b472ac193670b8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a75fa-5ac1-4cfb-b644-b14e32f59755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a75fa-5ac1-4cfb-b644-b14e32f59755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e37ab2e-f55c-4c6b-b567-920b4d377ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:25 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e37ab2e-f55c-4c6b-b567-920b4d377ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501fc744-9049-44c3-bea4-f4827b02faca', 'volume_name': 'volume-501fc744-9049-44c3-bea4-f4827b02faca', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564be0d8-41f2-482d-b740-d10e7fee4e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564be0d8-41f2-482d-b740-d10e7fee4e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c71ec8-11db-41ce-ac6e-f1f2df6d2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Volume 501fc744-9049-44c3-bea4-f4827b02faca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501fc744-9049-44c3-bea4-f4827b02faca', 'volume_size': 1} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1366368937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501fc744-9049-44c3-bea4-f4827b02faca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5cd450c3404c3ebe60878a43abb105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:26Z,use_quota=True,user_id='b41fcaafa2f24018b472ac193670b8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Creating volume 501fc744-9049-44c3-bea4-f4827b02faca {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:25 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade 1G" returned: 0 in 0.497s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Downloaded image cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume fb3d724b-3cd4-431c-8396-48a0889afade successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 for user 0807019d59ce4ceb87e86cf31a90dfb5 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Marking volume fb3d724b-3cd4-431c-8396-48a0889afade as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:50:25 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca 1073741824 Sep 07 16:50:25 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Copying metadata from image cd35955c-2cfe-436b-a709-f0de1afb8856 to fb3d724b-3cd4-431c-8396-48a0889afade. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Creating volume glance metadata for volume fb3d724b-3cd4-431c-8396-48a0889afade backed by image cd35955c-2cfe-436b-a709-f0de1afb8856 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:50:25 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d.91dcc0b9-e697-474c-af88-e65e334991e2" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-91dcc0b9-e697-474c-af88-e65e334991e2" released by "_delete_snapshot" :: held 2.191s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-a74b8681-b3e3-4f31-907a-862b05f2f93d" released by "delete_snapshot" :: held 2.221s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61947244-a9d7-4283-ac79-10cdd590a630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3d724b-3cd4-431c-8396-48a0889afade', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a262112-799d-4e6c-b2f8-e6ff36ec165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Volume volume-fb3d724b-3cd4-431c-8396-48a0889afade (fb3d724b-3cd4-431c-8396-48a0889afade): created successfully Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a262112-799d-4e6c-b2f8-e6ff36ec165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Flow 'volume_create_manager' (d232f947-96e3-4d25-a6c5-c67761ac7c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1e48e425-79f5-4eb9-bafd-241cabc89ee2 tempest-TestShelveInstance-713532939 None] Created volume successfully. Sep 07 16:50:26 devstack cinder-volume[87492]: WARNING cinder.quota [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1040002425 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1040002425, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] Created reservations ['4ac7b457-ef8b-4f92-b400-2108b35143b9', '0603464a-bffb-4a8d-a156-1a9bee5a96aa', '2056cf8a-8e49-4da6-b20c-436715f5857a', 'f65b2ea7-d922-4078-bc4b-9b6610618e94'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8dddf43d-722d-4123-b217-b3f5048ae6ca tempest-GroupSnapshotsTest-331254160 None] group_snapshot b5ef6468-5292-468b-8058-a8614395180e: deleted successfully Sep 07 16:50:26 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca 1073741824" returned: 0 in 0.555s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:26 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca Sep 07 16:50:26 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:26 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca" returned: 0 in 0.247s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c71ec8-11db-41ce-ac6e-f1f2df6d2929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501fc744-9049-44c3-bea4-f4827b02faca', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912ca726-445f-42b2-8589-5f8bafadcca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Volume volume-501fc744-9049-44c3-bea4-f4827b02faca (501fc744-9049-44c3-bea4-f4827b02faca): created successfully Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912ca726-445f-42b2-8589-5f8bafadcca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Flow 'volume_create_manager' (d8dcc11d-f21c-4b33-b056-54066b7ae624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7bd7f55b-22ef-4667-94c6-2b3d0fb39f3b tempest-VolumesListAdminTestJSON-889661982 None] Created volume successfully. Sep 07 16:50:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-a74b8681-b3e3-4f31-907a-862b05f2f93d" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-a74b8681-b3e3-4f31-907a-862b05f2f93d" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[796a5a29-35a1-425e-8095-eb30fd6a0ed4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:27 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d Sep 07 16:50:27 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:27 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d" returned: 0 in 0.459s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:27 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d Sep 07 16:50:27 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:28 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a74b8681-b3e3-4f31-907a-862b05f2f93d" returned: 0 in 0.315s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-a74b8681-b3e3-4f31-907a-862b05f2f93d" released by "delete_volume" :: held 0.859s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['99010ab7-7b14-4bfb-877d-755ac1021ffc'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:28 devstack cinder-volume[87492]: WARNING cinder.db.api [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1040002425'] Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['451fd23f-a336-4677-a53d-873f5865eb60', '1500d067-0993-4d1a-a2c1-c872cbb7fedc', '03eae5a2-5959-4343-b028-a78ab18e00f4', '340eee98-5337-47fc-83bc-2fee599bacca'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Flow 'volume_create_manager' (68dec459-24e5-471b-93f9-4b41d64f7a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d332fea5-032f-4ffc-b5a6-cbea93bc3d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d332fea5-032f-4ffc-b5a6-cbea93bc3d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-128476911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f3531c-5d18-4525-a91b-14ada42aa2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5cd450c3404c3ebe60878a43abb105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:28Z,use_quota=True,user_id='b41fcaafa2f24018b472ac193670b8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7791d2-6885-4911-894e-f1ed293206a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7791d2-6885-4911-894e-f1ed293206a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c07b65-c4bc-45b2-9251-7bcf38948516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c07b65-c4bc-45b2-9251-7bcf38948516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f3531c-5d18-4525-a91b-14ada42aa2fd', 'volume_name': 'volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382cca82-ab28-41d0-a6a1-127c15489e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382cca82-ab28-41d0-a6a1-127c15489e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64bd4f8-e816-4d37-9f0a-1da88add17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:28 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Volume b3f3531c-5d18-4525-a91b-14ada42aa2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd', 'volume_size': 1} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-128476911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f3531c-5d18-4525-a91b-14ada42aa2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5cd450c3404c3ebe60878a43abb105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:28Z,use_quota=True,user_id='b41fcaafa2f24018b472ac193670b8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Creating volume b3f3531c-5d18-4525-a91b-14ada42aa2fd {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:28 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:28 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd 1073741824 Sep 07 16:50:28 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:28 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:28 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:29 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-75869dac-53d6-4a82-83a4-ed3927f0c9e6 tempest-GroupSnapshotsTest-331254160 None] Delete group completed successfully. Sep 07 16:50:29 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd 1073741824" returned: 0 in 0.663s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:29 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd Sep 07 16:50:29 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:29 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd" returned: 0 in 0.322s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64bd4f8-e816-4d37-9f0a-1da88add17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d752ef57-bd66-4dd8-8259-ea13ddbf8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Volume volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd (b3f3531c-5d18-4525-a91b-14ada42aa2fd): created successfully Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d752ef57-bd66-4dd8-8259-ea13ddbf8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Flow 'volume_create_manager' (68dec459-24e5-471b-93f9-4b41d64f7a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-caa64657-9d1d-403b-80a6-464694b78286 tempest-VolumesListAdminTestJSON-889661982 None] Created volume successfully. Sep 07 16:50:30 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e522f309-ce93-4ec7-bcab-befdf344ed89 tempest-GroupSnapshotsTest-331254160 None] Group tempest-GroupSnapshotsTest-Group-1262179464: creating Sep 07 16:50:30 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e522f309-ce93-4ec7-bcab-befdf344ed89 tempest-GroupSnapshotsTest-331254160 None] Group tempest-GroupSnapshotsTest-Group-1262179464: created successfully Sep 07 16:50:30 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e522f309-ce93-4ec7-bcab-befdf344ed89 tempest-GroupSnapshotsTest-331254160 None] Create group completed successfully. Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-2e42c85b-5053-44b2-a9dc-c55283c57667 req-6e4192fb-ff11-42a2-94e8-e878d9075f45 tempest-TestShelveInstance-713532939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-2e42c85b-5053-44b2-a9dc-c55283c57667 req-6e4192fb-ff11-42a2-94e8-e878d9075f45 tempest-TestShelveInstance-713532939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-2e42c85b-5053-44b2-a9dc-c55283c57667 req-6e4192fb-ff11-42a2-94e8-e878d9075f45 tempest-TestShelveInstance-713532939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-2e42c85b-5053-44b2-a9dc-c55283c57667 req-6e4192fb-ff11-42a2-94e8-e878d9075f45 tempest-TestShelveInstance-713532939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-fb3d724b-3cd4-431c-8396-48a0889afade', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd82f68c3-eb9c-4009-a43b-4f80a5daa982', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:50:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-2e42c85b-5053-44b2-a9dc-c55283c57667 req-6e4192fb-ff11-42a2-94e8-e878d9075f45 tempest-TestShelveInstance-713532939 None] attachment_update completed successfully. Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Flow 'volume_create_manager' (7eba3e61-aece-4782-9e0d-0069a616234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc9fc6c-2bf6-436f-ad56-96e1d0bda32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc9fc6c-2bf6-436f-ad56-96e1d0bda32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2052926844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b099db-ae6c-4e21-b8f3-872edd419f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5cd450c3404c3ebe60878a43abb105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:32Z,use_quota=True,user_id='b41fcaafa2f24018b472ac193670b8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74119a0a-b409-4e5d-837b-323462818923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74119a0a-b409-4e5d-837b-323462818923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d6c21b-ac45-4b2b-99f0-2fc732cc4445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d6c21b-ac45-4b2b-99f0-2fc732cc4445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b099db-ae6c-4e21-b8f3-872edd419f5e', 'volume_name': 'volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585a0ca2-bc6b-4b64-8d66-a54c9d529801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585a0ca2-bc6b-4b64-8d66-a54c9d529801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d3f8ea-eede-4b58-b3b2-7589b911a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:31 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Volume c1b099db-ae6c-4e21-b8f3-872edd419f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e', 'volume_size': 1} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2052926844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b099db-ae6c-4e21-b8f3-872edd419f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5cd450c3404c3ebe60878a43abb105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:32Z,use_quota=True,user_id='b41fcaafa2f24018b472ac193670b8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Creating volume c1b099db-ae6c-4e21-b8f3-872edd419f5e {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:31 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:31 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e 1073741824 Sep 07 16:50:31 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (bfb81eff-6e2f-4000-8f2a-8bc7c5c5b764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65df55a3-9ecc-4f66-9931-5d86ffa30498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65df55a3-9ecc-4f66-9931-5d86ffa30498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1715268726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5334dddb-6163-4676-a0fa-39e58abe4c32,host='devstack@QuobyteHD#QuobyteHD',id=d136c69c-b168-4411-9f05-5fa8ab7fe5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:32Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f49a620-cfae-40c1-a731-f8683b2b39d7),volume_type_id=7f49a620-cfae-40c1-a731-f8683b2b39d7)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa3da4d-fee8-4426-af57-ceaafbd75746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa3da4d-fee8-4426-af57-ceaafbd75746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318f8b2f-2045-4851-a95d-8f56d7159343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318f8b2f-2045-4851-a95d-8f56d7159343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd136c69c-b168-4411-9f05-5fa8ab7fe5d0', 'volume_name': 'volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd6a97a-ef1e-4e5d-891c-310b1c6a0cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd6a97a-ef1e-4e5d-891c-310b1c6a0cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bbd5a4-699a-4c35-8bf0-0e6887b5f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Volume d136c69c-b168-4411-9f05-5fa8ab7fe5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0', 'volume_size': 1} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:32 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e 1073741824" returned: 0 in 0.832s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:32 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e Sep 07 16:50:32 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:32 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5334dddb-6163-4676-a0fa-39e58abe4c32,created_at=2026-09-07T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1715268726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5334dddb-6163-4676-a0fa-39e58abe4c32,host='devstack@QuobyteHD#QuobyteHD',id=d136c69c-b168-4411-9f05-5fa8ab7fe5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:32Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f49a620-cfae-40c1-a731-f8683b2b39d7),volume_type_id=7f49a620-cfae-40c1-a731-f8683b2b39d7)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Creating volume d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:32 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d3f8ea-eede-4b58-b3b2-7589b911a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1509f94-9f0a-4b07-9388-67cc95453057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:32 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 1073741824 Sep 07 16:50:32 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Volume volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e (c1b099db-ae6c-4e21-b8f3-872edd419f5e): created successfully Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1509f94-9f0a-4b07-9388-67cc95453057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Flow 'volume_create_manager' (7eba3e61-aece-4782-9e0d-0069a616234a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-273a0b74-59eb-478a-8297-9f21ff2431f0 tempest-VolumesListAdminTestJSON-889661982 None] Created volume successfully. Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:33 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:33 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:33 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 1073741824" returned: 0 in 0.556s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:33 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 Sep 07 16:50:33 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:33 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:33 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" returned: 0 in 0.411s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.534s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3bbd5a4-699a-4c35-8bf0-0e6887b5f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9577ec0c-d6b2-4401-9208-750d99bac0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:34 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Volume volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 (d136c69c-b168-4411-9f05-5fa8ab7fe5d0): created successfully Sep 07 16:50:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9577ec0c-d6b2-4401-9208-750d99bac0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (bfb81eff-6e2f-4000-8f2a-8bc7c5c5b764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-bf4b0eb2-8425-4b2c-8e61-c5aef5f83e90 tempest-GroupSnapshotsTest-331254160 None] Created volume successfully. Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Flow 'volume_create_manager' (15ee3cc9-f528-42a6-b43a-29c78898b12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9301dc1f-3745-4a16-8d52-f79cde1e7f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9301dc1f-3745-4a16-8d52-f79cde1e7f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782d2230-3f6b-40b7-9f0d-73e2ab60bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0efe95283d44f8a7d7ee2e54b1e4f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:35Z,use_quota=True,user_id='7c0ac265bf534e93858ac9ce953f3047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48aee37-34f8-4ec1-8bf2-a87c2dde52ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48aee37-34f8-4ec1-8bf2-a87c2dde52ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6540a41-f607-4f2f-8730-ad60baf0289d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6540a41-f607-4f2f-8730-ad60baf0289d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782d2230-3f6b-40b7-9f0d-73e2ab60bdd3', 'volume_name': 'volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d13ff2-f86b-43a8-9405-eef84327c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d13ff2-f86b-43a8-9405-eef84327c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4296a3eb-3cb3-425f-928f-f76b4c2b9c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:35 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Volume 782d2230-3f6b-40b7-9f0d-73e2ab60bdd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3', 'volume_size': 1} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782d2230-3f6b-40b7-9f0d-73e2ab60bdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0efe95283d44f8a7d7ee2e54b1e4f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:35Z,use_quota=True,user_id='7c0ac265bf534e93858ac9ce953f3047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Creating volume 782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:35 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:35 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 1073741824 Sep 07 16:50:35 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 1073741824" returned: 0 in 1.036s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:36 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:36 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 Sep 07 16:50:36 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (56b39b6f-39f0-4f39-b3c4-aa9fc02c3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfb0968-cfce-4067-817b-e5fc0f2a8b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfb0968-cfce-4067-817b-e5fc0f2a8b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308802307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5334dddb-6163-4676-a0fa-39e58abe4c32,host='devstack@QuobyteHD#QuobyteHD',id=b3af74f4-ec01-4140-9aca-e7e6fb9197cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:37Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f49a620-cfae-40c1-a731-f8683b2b39d7),volume_type_id=7f49a620-cfae-40c1-a731-f8683b2b39d7)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f4edcb-9a8d-4baf-90c1-88e83cad6515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f4edcb-9a8d-4baf-90c1-88e83cad6515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f12352-bd42-4c95-a362-b6093ec33a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f12352-bd42-4c95-a362-b6093ec33a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3af74f4-ec01-4140-9aca-e7e6fb9197cb', 'volume_name': 'volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88858d82-3c99-4244-ac06-9cbf41773a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88858d82-3c99-4244-ac06-9cbf41773a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1a9a00-4a1b-49f3-b32a-eb08948d2e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:36 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Volume b3af74f4-ec01-4140-9aca-e7e6fb9197cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb', 'volume_size': 1} Sep 07 16:50:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:37 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3" returned: 0 in 0.538s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.164s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5334dddb-6163-4676-a0fa-39e58abe4c32,created_at=2026-09-07T14:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308802307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5334dddb-6163-4676-a0fa-39e58abe4c32,host='devstack@QuobyteHD#QuobyteHD',id=b3af74f4-ec01-4140-9aca-e7e6fb9197cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:37Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f49a620-cfae-40c1-a731-f8683b2b39d7),volume_type_id=7f49a620-cfae-40c1-a731-f8683b2b39d7)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Creating volume b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:37 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:37 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb 1073741824 Sep 07 16:50:37 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4296a3eb-3cb3-425f-928f-f76b4c2b9c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad05df7-d651-4908-9848-9b9749e4a818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:37 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Volume volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 (782d2230-3f6b-40b7-9f0d-73e2ab60bdd3): created successfully Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad05df7-d651-4908-9848-9b9749e4a818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Flow 'volume_create_manager' (15ee3cc9-f528-42a6-b43a-29c78898b12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2694995c-1975-4efd-baeb-34fc3a6aa4ed tempest-VolumesListAdminTestJSON-954637696 None] Created volume successfully. Sep 07 16:50:37 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb 1073741824" returned: 0 in 0.606s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:37 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb Sep 07 16:50:37 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:38 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1a9a00-4a1b-49f3-b32a-eb08948d2e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac82b7d-d43c-464e-b0e5-796fbfb345d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:38 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Volume volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb (b3af74f4-ec01-4140-9aca-e7e6fb9197cb): created successfully Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac82b7d-d43c-464e-b0e5-796fbfb345d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (56b39b6f-39f0-4f39-b3c4-aa9fc02c3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:38 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9791732b-54ed-4c50-bff0-97c8456aa13e tempest-GroupSnapshotsTest-331254160 None] Created volume successfully. Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Acquiring lock "cinder-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Lock "cinder-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Acquiring lock "cinder-quobyte-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Lock "cinder-quobyte-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3" acquired by "delete_volume" :: waited 0.041s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "cinder-c1b099db-ae6c-4e21-b8f3-872edd419f5e-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5c34cb-ea20-4be6-8dee-c9b171d0eb5f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-c1b099db-ae6c-4e21-b8f3-872edd419f5e-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "cinder-quobyte-c1b099db-ae6c-4e21-b8f3-872edd419f5e" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-quobyte-c1b099db-ae6c-4e21-b8f3-872edd419f5e" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaab229-6841-445e-a823-e2d202c1d180]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:38 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 Sep 07 16:50:38 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:39 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e Sep 07 16:50:39 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:39 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3" returned: 0 in 0.933s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:39 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3 Sep 07 16:50:39 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:39 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e" returned: 0 in 0.860s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:39 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e Sep 07 16:50:39 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9cca134e-545a-48bf-8787-4c626e0646a9 tempest-GroupSnapshotsTest-331254160 None] Update group completed successfully. Sep 07 16:50:40 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3" returned: 0 in 0.465s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Lock "cinder-quobyte-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3" released by "delete_volume" :: held 1.517s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Created reservations ['3e710fba-69d0-4183-9964-64ccd9f3238f', 'ca529f84-e616-4e6e-b748-23b1b1866450', '2ec2de17-171b-4ac0-a1d9-3a57991b16d7', '7eece6aa-8934-4729-889b-a49c3e2b5efb'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:40 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c1b099db-ae6c-4e21-b8f3-872edd419f5e" returned: 0 in 0.617s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:40 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:40 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-quobyte-c1b099db-ae6c-4e21-b8f3-872edd419f5e" released by "delete_volume" :: held 1.579s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Created reservations ['656403b2-e77b-4585-b90f-0983cd8c7500', 'f07da888-c637-486a-a929-82976767dd7e', 'ddf75a8f-060c-484a-bf76-46ce0dc34916', 'c6fdc88a-dc4b-472a-b05f-16d19c77ec9d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:40 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:40 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:40 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.443s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Deleted volume successfully. Sep 07 16:50:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a11161cc-20b5-4d5f-8a17-4da7c41ba2f5 tempest-VolumesListAdminTestJSON-954637696 None] Lock "cinder-782d2230-3f6b-40b7-9f0d-73e2ab60bdd3-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:41 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.613s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Deleted volume successfully. Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-986b6d8d-d362-4780-8728-28d91d060378 tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-c1b099db-ae6c-4e21-b8f3-872edd419f5e-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "cinder-b3f3531c-5d18-4525-a91b-14ada42aa2fd-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-b3f3531c-5d18-4525-a91b-14ada42aa2fd-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0f5755e6-4352-4edf-b568-2a0434107917 tempest-GroupSnapshotsTest-331254160 None] Update group completed successfully. Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "cinder-quobyte-b3f3531c-5d18-4525-a91b-14ada42aa2fd" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-quobyte-b3f3531c-5d18-4525-a91b-14ada42aa2fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec27908c-0d60-48e3-a1e0-2322af414863]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:41 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd Sep 07 16:50:41 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:42 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd" returned: 0 in 0.606s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:42 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd Sep 07 16:50:42 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:42 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3f3531c-5d18-4525-a91b-14ada42aa2fd" returned: 0 in 0.380s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-quobyte-b3f3531c-5d18-4525-a91b-14ada42aa2fd" released by "delete_volume" :: held 1.072s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Created reservations ['e4d807e4-c245-40a0-9f9f-62997156c955', '69e9521e-14c4-4128-930b-dd966e52b08d', '53cb083d-b0cb-4f2f-8af0-7079c4404762', '4157a836-67f0-4d49-9920-f7dee9bea217'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:42 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a7371092-d53a-474e-816c-f342faa0bcb0 tempest-GroupSnapshotsTest-331254160 None] Update group completed successfully. Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:42 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:42 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:43 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.498s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:43 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Deleted volume successfully. Sep 07 16:50:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0493652b-094e-4e1d-a572-97bde182dc4f tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-b3f3531c-5d18-4525-a91b-14ada42aa2fd-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "cinder-501fc744-9049-44c3-bea4-f4827b02faca-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:44 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-72bc5824-91a5-4516-8149-571e72aca7b2 tempest-GroupSnapshotsTest-331254160 None] Update group completed successfully. Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-501fc744-9049-44c3-bea4-f4827b02faca-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "cinder-quobyte-501fc744-9049-44c3-bea4-f4827b02faca" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-quobyte-501fc744-9049-44c3-bea4-f4827b02faca" acquired by "delete_volume" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8edfaa-e1cf-43f0-b262-784ed23eadc0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:44 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca Sep 07 16:50:44 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:44 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca" returned: 0 in 0.490s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:44 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca Sep 07 16:50:44 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:45 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-501fc744-9049-44c3-bea4-f4827b02faca" returned: 0 in 0.406s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-quobyte-501fc744-9049-44c3-bea4-f4827b02faca" released by "delete_volume" :: held 0.966s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=165,cinder:INSERT=41,cinder:UPDATE=169,cinder:DELETE=8 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Created reservations ['13c2ea09-7c7d-4c64-8aa1-53acbf1b7f40', '8f52391e-7a6d-4844-af02-44038758089d', '36db3b6c-9a04-4c31-8425-d34faed15f4f', '69c6111f-e976-4a51-a44b-4bf0ce6708de'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:45 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:45 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:45 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.306s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Deleted volume successfully. Sep 07 16:50:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] GroupSnapshot b12bed88-c019-416c-a802-832d47630282: creating. Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Group snapshot b12bed88-c019-416c-a802-832d47630282: creating. {{(pid=87492) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4f6d92d8-6090-4f2d-afc9-1e90b8655ddb tempest-VolumesListAdminTestJSON-889661982 None] Lock "cinder-501fc744-9049-44c3-bea4-f4827b02faca-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Creating offline snapshot 9a46a43a-2d10-489d-a8bc-9af29b32bfed of volume d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed248db2-511c-4b0a-b077-47ce8817a453]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:45 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 Sep 07 16:50:45 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:46 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" returned: 0 in 0.470s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:46 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed 1G Sep 07 16:50:46 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:46 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed 1G" returned: 0 in 0.558s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:46 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed Sep 07 16:50:46 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:47 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed" returned: 0 in 0.475s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:47 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:50:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:47 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed Sep 07 16:50:47 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:47 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed" returned: 0 in 0.271s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:47 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.info Sep 07 16:50:47 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:47 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.info" returned: 0 in 0.294s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:47 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:50:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:47 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.info Sep 07 16:50:47 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:48 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.info" returned: 0 in 0.385s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Creating offline snapshot fb8bc8cb-3bd0-4390-a951-204547da179b of volume b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c539513-55e8-4559-a244-390b0a9b8fd2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:48 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb Sep 07 16:50:48 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:48 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" returned: 0 in 0.562s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:49 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b 1G Sep 07 16:50:49 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:49 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b 1G" returned: 0 in 0.535s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:49 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b Sep 07 16:50:49 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:50 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b" returned: 0 in 0.552s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:50 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:50 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b Sep 07 16:50:50 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=156,cinder:INSERT=43,cinder:UPDATE=178,cinder:DELETE=13 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Flow 'volume_create_manager' (ccde8de4-f178-4e0d-bf56-5df96080fa8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c38179-3654-4255-9c54-323ec9eca5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c38179-3654-4255-9c54-323ec9eca5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-87079984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e7a013-4d74-43a9-8938-c9adb1dfbdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5f703491f7492e93e6536a7cdaf905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:50Z,use_quota=True,user_id='09ad780b42c942dc9d484e8e0d4ca3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb75f7a-6490-41a0-b586-f13c774afffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb75f7a-6490-41a0-b586-f13c774afffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb2e7a8-b753-44e8-a465-82cd84b7af83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:50:50 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:50 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.info Sep 07 16:50:50 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb2e7a8-b753-44e8-a465-82cd84b7af83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8e7a013-4d74-43a9-8938-c9adb1dfbdf2', 'volume_name': 'volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09b5fbf-5876-4386-a7e2-dc1ee4601d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d09b5fbf-5876-4386-a7e2-dc1ee4601d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f375266-4ff2-46d6-bbba-c57419911c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Volume a8e7a013-4d74-43a9-8938-c9adb1dfbdf2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Trying to clone a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 from image cd35955c-2cfe-436b-a709-f0de1afb8856 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:50:50 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.info" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:50 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:50:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:50 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.info Sep 07 16:50:50 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:51 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.info" returned: 0 in 0.361s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:51 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:50:51 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Image download 20.69 MB at 20.69 MB/s Sep 07 16:50:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a69132eb-e0ab-4b9a-beff-153536bf5b26 tempest-GroupSnapshotsTest-331254160 None] group_snapshot b12bed88-c019-416c-a802-832d47630282: created successfully Sep 07 16:50:51 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25a2ad7-b53e-44a8-a0a5-143f52374202]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:51 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD Sep 07 16:50:51 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:51 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:51 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 is fetched for user 09ad780b42c942dc9d484e8e0d4ca3c7. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f80c23-9da9-40e7-8298-28dda86328ad]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:52 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD Sep 07 16:50:52 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] group_snapshot b12bed88-c019-416c-a802-832d47630282: deleting Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] group_snapshot b12bed88-c019-416c-a802-832d47630282: deleting {{(pid=87492) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-9a46a43a-2d10-489d-a8bc-9af29b32bfed" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-9a46a43a-2d10-489d-a8bc-9af29b32bfed" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Deleting offline snapshot 9a46a43a-2d10-489d-a8bc-9af29b32bfed of volume d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:50:52 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] snapshot_file for this snap is: volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD" returned: 0 in 0.699s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-87079984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e7a013-4d74-43a9-8938-c9adb1dfbdf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5f703491f7492e93e6536a7cdaf905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:50Z,use_quota=True,user_id='09ad780b42c942dc9d484e8e0d4ca3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Creating volume a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:52 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b47584-76c4-43a7-b018-e9f6d08b581b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:52 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 1073741824 Sep 07 16:50:52 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:53 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed Sep 07 16:50:53 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:53 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 1073741824" returned: 0 in 0.528s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:53 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 Sep 07 16:50:53 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:53 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed" returned: 0 in 0.637s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b28dcb0-7aee-4433-8ec9-651096648530]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:53 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 Sep 07 16:50:53 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:53 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Attempting download of cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume a8e7a013-4d74-43a9-8938-c9adb1dfbdf2. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Flow 'volume_create_manager' (22a51495-eedc-442f-aeb1-6ee456b8c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0ea40b-842c-48ad-a726-7b610714cc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9bb8bf-752d-4cdd-a272-3bd5c4149082]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_9aw36gv4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0ea40b-842c-48ad-a726-7b610714cc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-252261294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453be9992aff40cab2b33f8751906f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:54Z,use_quota=True,user_id='05e57477ebde41808af97f88c9c3278d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbec7d1-8ef2-441a-b293-7e6fa00743ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbec7d1-8ef2-441a-b293-7e6fa00743ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51465f09-9825-4dd7-9f7c-2f4be99e8d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51465f09-9825-4dd7-9f7c-2f4be99e8d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a', 'volume_name': 'volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92acbd8-d640-4c5f-b02a-98c3841ec5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92acbd8-d640-4c5f-b02a-98c3841ec5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7c18c7-ee6d-4b17-8072-73ccec9c5471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Volume 7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a', 'volume_size': 1} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-252261294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453be9992aff40cab2b33f8751906f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:50:54Z,use_quota=True,user_id='05e57477ebde41808af97f88c9c3278d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Creating volume 7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:53 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:50:53 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:50:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" returned: 0 in 0.531s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:54 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a 1073741824 Sep 07 16:50:54 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:54 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed Sep 07 16:50:54 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:54 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_9aw36gv4 Sep 07 16:50:54 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:54 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_9aw36gv4" returned: 0 in 0.560s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_9aw36gv4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:54 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed" returned: 0 in 0.513s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:54 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed Sep 07 16:50:54 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:54 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_9aw36gv4 Sep 07 16:50:54 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:54 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a 1073741824" returned: 0 in 0.622s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:54 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a Sep 07 16:50:54 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:54 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0.9a46a43a-2d10-489d-a8bc-9af29b32bfed" returned: 0 in 0.315s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-9a46a43a-2d10-489d-a8bc-9af29b32bfed" released by "_delete_snapshot" :: held 2.181s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" released by "delete_snapshot" :: held 2.229s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:54 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_9aw36gv4" returned: 1 in 0.454s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_9aw36gv4' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29262e-3940-4c9a-8f7c-624da48940cb]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-fb8bc8cb-3bd0-4390-a951-204547da179b" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-fb8bc8cb-3bd0-4390-a951-204547da179b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Deleting offline snapshot fb8bc8cb-3bd0-4390-a951-204547da179b of volume b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:50:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] snapshot_file for this snap is: volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:50:54 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a" returned: 0 in 0.333s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7c18c7-ee6d-4b17-8072-73ccec9c5471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dbebd6-2591-42ed-89de-cd42db21624a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[715de02b-2744-4700-b3c5-0db8e19d36ed]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:55 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Volume volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a (7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a): created successfully Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dbebd6-2591-42ed-89de-cd42db21624a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Flow 'volume_create_manager' (22a51495-eedc-442f-aeb1-6ee456b8c519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f4460371-4109-4e28-9ac4-a3b3c0c68893 tempest-VolumesMetadataTest-2122883266 None] Created volume successfully. Sep 07 16:50:55 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD Sep 07 16:50:55 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:55 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b Sep 07 16:50:55 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:55 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] cd35955c-2cfe-436b-a709-f0de1afb8856 was qcow2, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:55 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 Sep 07 16:50:55 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:55 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b" returned: 0 in 0.488s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f435d0-10a1-4973-acce-b132bffb3599]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:55 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb Sep 07 16:50:55 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:55 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" returned: 0 in 0.402s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:55 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b Sep 07 16:50:55 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:56 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b" returned: 0 in 0.480s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:56 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b Sep 07 16:50:56 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:56 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb.fb8bc8cb-3bd0-4390-a951-204547da179b" returned: 0 in 0.281s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-fb8bc8cb-3bd0-4390-a951-204547da179b" released by "_delete_snapshot" :: held 1.805s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" released by "delete_snapshot" :: held 1.833s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:56 devstack cinder-volume[87492]: WARNING cinder.quota [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-197836893 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-197836893, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:56 devstack cinder-volume[87492]: WARNING cinder.quota [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-197836893 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-197836893, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Acquiring lock "cinder-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['61585103-f047-4e7d-88c9-456df1e2c03b', 'f16c0347-428f-4427-b2cd-981aa83b06ea', '4c3340a9-3a3f-4b25-868e-df5f09796a40', 'ebf585c6-c807-4a7a-920f-bbc2cd47c356'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Lock "cinder-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Acquiring lock "cinder-quobyte-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Lock "cinder-quobyte-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543c8c3-e5bd-4686-a9d2-22ec323bfa55]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['a1bff210-69a6-4e71-b05b-d326bd69b58c', '5ce63cb7-8e7f-4d33-bb00-792b96f27ef5', '7e926844-2ab7-40d2-88cd-b89bc72c5bc5', 'cce3be59-5698-4a65-b633-d2fecb91def7'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:57 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a Sep 07 16:50:57 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c5134052-3242-4dfc-82dc-7bda49e2ccd2 tempest-GroupSnapshotsTest-331254160 None] group_snapshot b12bed88-c019-416c-a802-832d47630282: deleted successfully Sep 07 16:50:57 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a" returned: 0 in 0.430s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:57 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a Sep 07 16:50:57 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:57 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2" returned: 0 in 2.345s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_yf0kl784devstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:50:57 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Converted 112.00 MB image at 47.73 MB/s Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:57 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 1G Sep 07 16:50:57 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:57 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" acquired by "delete_volume" :: waited 0.058s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Lock "cinder-quobyte-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a" released by "delete_volume" :: held 0.957s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9cf1da-3ae8-4b57-9fd3-86e4555dc75a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Created reservations ['f6e9d7d7-755a-494d-ba9a-a91b74723687', 'e275b1f2-d009-43dc-8b1a-80fa603fb9fc', '9a90c7a3-b2b1-4e8b-99e8-4f3af27974f8', 'c01a93bc-9a21-4a12-9f46-59b2d78c5a18'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:58 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb Sep 07 16:50:58 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:58 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 1G" returned: 0 in 0.418s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Downloaded image cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:50:58 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:58 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 for user 09ad780b42c942dc9d484e8e0d4ca3c7 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Marking volume a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Copying metadata from image cd35955c-2cfe-436b-a709-f0de1afb8856 to a8e7a013-4d74-43a9-8938-c9adb1dfbdf2. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Creating volume glance metadata for volume a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 backed by image cd35955c-2cfe-436b-a709-f0de1afb8856 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f375266-4ff2-46d6-bbba-c57419911c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee6f996-fa14-4f3f-98bc-72e8660ae8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:50:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Volume volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 (a8e7a013-4d74-43a9-8938-c9adb1dfbdf2): created successfully Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee6f996-fa14-4f3f-98bc-72e8660ae8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Flow 'volume_create_manager' (ccde8de4-f178-4e0d-bf56-5df96080fa8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:50:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-41509430-f948-475c-9c19-c2d7218a0382 tempest-VolumesImageMetadata-680390697 None] Created volume successfully. Sep 07 16:50:58 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" returned: 0 in 0.431s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:58 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb Sep 07 16:50:58 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:58 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.290s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Deleted volume successfully. Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-62d389d4-9a6a-483e-a6e9-f95b9e50185e tempest-VolumesMetadataTest-2122883266 None] Lock "cinder-7fbef7f7-3ac1-44c4-8ddd-b28b1a249d3a-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:58 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-b3af74f4-ec01-4140-9aca-e7e6fb9197cb" released by "delete_volume" :: held 0.781s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e929147-5fa8-4da6-8c33-6b01f0c61669]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:58 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 Sep 07 16:50:58 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:59 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" returned: 0 in 0.433s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:59 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0 Sep 07 16:50:59 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Acquiring lock "cinder-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Lock "cinder-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:59 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Acquiring lock "cinder-quobyte-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" returned: 0 in 0.287s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Lock "cinder-quobyte-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-d136c69c-b168-4411-9f05-5fa8ab7fe5d0" released by "delete_volume" :: held 0.800s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b8476-bba0-48a4-8029-4ac7644168cc]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['effd9210-c5d9-498a-bca7-a799440d1bb8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:59 devstack cinder-volume[87492]: WARNING cinder.quota [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-197836893 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-197836893, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:50:59 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 Sep 07 16:50:59 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['70089c14-c36b-49a1-a0a3-88b9478c180b', '5479e136-6821-40bb-bb2d-70ebf1a6885b', 'beac7d8e-3643-410c-b8dc-b63ce6125f30', 'a810a99b-6471-4ed8-931f-a08936bec7e5'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['276306c8-4760-4455-b150-0de0f14b87b5', 'abdcb643-f9a5-4680-8a52-59f2f4ac84c0', 'cea4eafa-6de1-4f11-b884-f49c8ca87bb5', '11b043e2-c2e6-469a-a6a1-7a0d1f91f34d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:59 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:50:59 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:59 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2" returned: 0 in 0.420s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:59 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2 Sep 07 16:50:59 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:00 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ac0daeea-2e61-40d0-8231-509444e79fd7 tempest-GroupSnapshotsTest-331254160 None] Delete group completed successfully. Sep 07 16:51:00 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2" returned: 0 in 0.302s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Lock "cinder-quobyte-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2" released by "delete_volume" :: held 0.777s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Created reservations ['27b85d8d-033c-452c-b21d-202e4aede278', '6000e4c0-6c06-4c15-aff6-9b56679a3bfd', '7626a1e5-5688-4e1c-85c7-859691a823bf', '08d8a63c-82e8-440b-8c1c-1e2bd7f2a9fc'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:00 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:00 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:00 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.373s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Deleted volume successfully. Sep 07 16:51:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a7714f4-93de-43cb-8435-85dd25938e55 tempest-VolumesImageMetadata-680390697 None] Lock "cinder-a8e7a013-4d74-43a9-8938-c9adb1dfbdf2-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8a12e9f2-996f-4c0e-bbb3-847da92715b9 tempest-GroupSnapshotsTest-331254160 None] Group tempest-GroupSnapshotsTest-Group-2117424343: creating Sep 07 16:51:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8a12e9f2-996f-4c0e-bbb3-847da92715b9 tempest-GroupSnapshotsTest-331254160 None] Group tempest-GroupSnapshotsTest-Group-2117424343: created successfully Sep 07 16:51:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8a12e9f2-996f-4c0e-bbb3-847da92715b9 tempest-GroupSnapshotsTest-331254160 None] Create group completed successfully. Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (c46a263d-9c70-4750-a6d5-a7cce05edd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a531cd6-3276-42c6-a3a2-b0a5502ab3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a531cd6-3276-42c6-a3a2-b0a5502ab3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908595395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6596e4c2-1bd2-4945-86d1-bf70cfa1bb96,host='devstack@QuobyteHD#QuobyteHD',id=ffcab0a1-0914-457e-ac9f-66e7b67a5d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:03Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd2509bd-d246-41fd-8d5c-b1aa286a376f),volume_type_id=cd2509bd-d246-41fd-8d5c-b1aa286a376f)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070996c4-074b-430c-89dd-26aba0181c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070996c4-074b-430c-89dd-26aba0181c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0454ef-f119-4c71-af2d-c98b212c020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0454ef-f119-4c71-af2d-c98b212c020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffcab0a1-0914-457e-ac9f-66e7b67a5d8d', 'volume_name': 'volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695f7f33-1cd9-43e4-a8c9-ba0484d7bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695f7f33-1cd9-43e4-a8c9-ba0484d7bf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f897c-4885-41e7-96c4-785b1237f57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:02 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Volume ffcab0a1-0914-457e-ac9f-66e7b67a5d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d', 'volume_size': 1} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6596e4c2-1bd2-4945-86d1-bf70cfa1bb96,created_at=2026-09-07T14:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-908595395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6596e4c2-1bd2-4945-86d1-bf70cfa1bb96,host='devstack@QuobyteHD#QuobyteHD',id=ffcab0a1-0914-457e-ac9f-66e7b67a5d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6112652adf4450ab00a205a2742c359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:03Z,use_quota=True,user_id='c93149d83ae74feaaada9b89ac70b372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd2509bd-d246-41fd-8d5c-b1aa286a376f),volume_type_id=cd2509bd-d246-41fd-8d5c-b1aa286a376f)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Creating volume ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:02 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:02 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d 1073741824 Sep 07 16:51:02 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:03 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d 1073741824" returned: 0 in 0.626s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:03 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d Sep 07 16:51:03 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:03 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" returned: 0 in 0.365s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f897c-4885-41e7-96c4-785b1237f57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bb2cb1-153a-42c7-bc71-1a31a25be0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Volume volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d (ffcab0a1-0914-457e-ac9f-66e7b67a5d8d): created successfully Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bb2cb1-153a-42c7-bc71-1a31a25be0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Flow 'volume_create_manager' (c46a263d-9c70-4750-a6d5-a7cce05edd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-57c9f95c-a8af-469e-84b7-b0791c611017 tempest-GroupSnapshotsTest-331254160 None] Created volume successfully. Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Flow 'volume_create_manager' (042188e1-9fe0-4474-a3e5-b993c3ec4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774d4bf3-05ff-4b2a-aa32-e03572150472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774d4bf3-05ff-4b2a-aa32-e03572150472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-22856062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9142b2f9-acb5-4157-b8b3-86f37fef1164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3305437da4bf7ae952f7bffae3c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:04Z,use_quota=True,user_id='f91f8d5b0509452da023aa8b7ec62979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8d3edf-1d30-4325-b98d-f390ac3fcab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8d3edf-1d30-4325-b98d-f390ac3fcab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667d9bd7-6a08-4307-b081-98a35bec8903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667d9bd7-6a08-4307-b081-98a35bec8903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9142b2f9-acb5-4157-b8b3-86f37fef1164', 'volume_name': 'volume-9142b2f9-acb5-4157-b8b3-86f37fef1164', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de252ee-a1f6-47af-b329-443be2282a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de252ee-a1f6-47af-b329-443be2282a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb9246f-135b-4ad3-b272-e1ffc706d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Volume 9142b2f9-acb5-4157-b8b3-86f37fef1164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9142b2f9-acb5-4157-b8b3-86f37fef1164', 'volume_size': 1} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-22856062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9142b2f9-acb5-4157-b8b3-86f37fef1164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3305437da4bf7ae952f7bffae3c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:04Z,use_quota=True,user_id='f91f8d5b0509452da023aa8b7ec62979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Creating volume 9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:04 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:04 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 1073741824 Sep 07 16:51:04 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:04 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 1073741824" returned: 0 in 0.468s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:04 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 Sep 07 16:51:04 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:05 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164" returned: 0 in 0.277s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb9246f-135b-4ad3-b272-e1ffc706d564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9142b2f9-acb5-4157-b8b3-86f37fef1164', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883cb43a-9715-457a-b539-b8618b6aed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:05 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Volume volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 (9142b2f9-acb5-4157-b8b3-86f37fef1164): created successfully Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883cb43a-9715-457a-b539-b8618b6aed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Flow 'volume_create_manager' (042188e1-9fe0-4474-a3e5-b993c3ec4de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f35a2199-e449-4955-8870-c1169e10b274 tempest-VolumesCloneTest-5748602 None] Created volume successfully. Sep 07 16:51:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] GroupSnapshot 93e6981f-ec1b-4a3e-a28b-0226fd88ef2e: creating. Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Flow 'volume_create_manager' (4ccf6d73-fe28-40c5-973f-aef6fdc354fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682164cc-6630-41d1-9909-51a657b8c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682164cc-6630-41d1-9909-51a657b8c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-148670194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6a8f18-ba45-410c-94aa-7e0530fc3955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f63e9743bc4ac593725773cd1e0971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:05Z,use_quota=True,user_id='34d63ccdeea640d0913abd1b8519b841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc588f1e-7f5e-41e9-8ddb-4027aaffb473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc588f1e-7f5e-41e9-8ddb-4027aaffb473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fff5706-ff0d-4146-8966-99dbbc2fea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fff5706-ff0d-4146-8966-99dbbc2fea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6a8f18-ba45-410c-94aa-7e0530fc3955', 'volume_name': 'volume-de6a8f18-ba45-410c-94aa-7e0530fc3955', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51590dd-1758-417c-b186-6f3c32f0e209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51590dd-1758-417c-b186-6f3c32f0e209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cbc4d4-1c54-46b6-b25b-8c5fa3d69868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:05 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Volume de6a8f18-ba45-410c-94aa-7e0530fc3955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6a8f18-ba45-410c-94aa-7e0530fc3955', 'volume_size': 1} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-148670194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6a8f18-ba45-410c-94aa-7e0530fc3955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f63e9743bc4ac593725773cd1e0971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:05Z,use_quota=True,user_id='34d63ccdeea640d0913abd1b8519b841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Creating volume de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:05 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Group snapshot 93e6981f-ec1b-4a3e-a28b-0226fd88ef2e: creating. {{(pid=87492) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 16:51:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:05 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 1073741824 Sep 07 16:51:05 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:06 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 1073741824" returned: 0 in 0.463s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:06 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 Sep 07 16:51:06 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:06 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955" returned: 0 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.839s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cbc4d4-1c54-46b6-b25b-8c5fa3d69868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6a8f18-ba45-410c-94aa-7e0530fc3955', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109b9d4b-8627-4ffc-883e-f85097b0864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Creating offline snapshot e2b84cd0-97fd-4cd4-a085-ac95341cac75 of volume ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:51:06 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Volume volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 (de6a8f18-ba45-410c-94aa-7e0530fc3955): created successfully Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109b9d4b-8627-4ffc-883e-f85097b0864e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Flow 'volume_create_manager' (4ccf6d73-fe28-40c5-973f-aef6fdc354fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5002b-9cff-4462-9c6a-a6c3cc0f0569]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d7150203-eafd-41e1-b180-dab9b1b5a372 tempest-SnapshotMetadataTestJSON-232477863 None] Created volume successfully. Sep 07 16:51:06 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d Sep 07 16:51:06 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Flow 'volume_create_manager' (fc3a9c75-4e8a-4543-9b3b-a0057ed303c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2acd9d-6dd0-4dd3-bf6d-93744bf24731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2acd9d-6dd0-4dd3-bf6d-93744bf24731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-301844157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e11008-ebc1-4e87-b331-03dfc04670f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3305437da4bf7ae952f7bffae3c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9142b2f9-acb5-4157-b8b3-86f37fef1164,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:07Z,use_quota=True,user_id='f91f8d5b0509452da023aa8b7ec62979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f626fe1b-1ee8-4e01-a10b-8b5a2928d938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f626fe1b-1ee8-4e01-a10b-8b5a2928d938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d06a07c-94be-4dc2-a7bb-3fed5f127704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d06a07c-94be-4dc2-a7bb-3fed5f127704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '08e11008-ebc1-4e87-b331-03dfc04670f6', 'volume_name': 'volume-08e11008-ebc1-4e87-b331-03dfc04670f6', 'volume_size': 2, 'source_volid': '9142b2f9-acb5-4157-b8b3-86f37fef1164', 'source_volstatus': 'available'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f4a406-2a1b-4900-be06-b9de306e22ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f4a406-2a1b-4900-be06-b9de306e22ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3dc382-d69a-452f-a7b4-8962dd22a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:07 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Volume 08e11008-ebc1-4e87-b331-03dfc04670f6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-08e11008-ebc1-4e87-b331-03dfc04670f6', 'volume_size': 2, 'source_volid': '9142b2f9-acb5-4157-b8b3-86f37fef1164', 'source_volstatus': 'available'} Sep 07 16:51:07 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" returned: 0 in 0.480s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:07 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 1G Sep 07 16:51:07 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:07 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 1G" returned: 0 in 0.478s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:07 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 Sep 07 16:51:07 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:08 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75" returned: 0 in 0.480s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:08 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:51:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:08 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 Sep 07 16:51:08 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:08 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75" returned: 0 in 0.287s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:08 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.info Sep 07 16:51:08 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:08 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.info" returned: 0 in 0.403s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:08 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:51:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:08 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.info Sep 07 16:51:08 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-465ed1ea-66ca-4f2f-89a8-918f8e501559 req-8cdd4ab9-782a-4601-816f-ff5584ed6b49 tempest-TestShelveInstance-713532939 None] Terminate volume connection completed successfully. Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-465ed1ea-66ca-4f2f-89a8-918f8e501559 req-8cdd4ab9-782a-4601-816f-ff5584ed6b49 tempest-TestShelveInstance-713532939 None] Deleting attachment d82f68c3-eb9c-4009-a43b-4f80a5daa982. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:51:09 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.info" returned: 0 in 0.301s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:09 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Cloning volume 9142b2f9-acb5-4157-b8b3-86f37fef1164 to volume 08e11008-ebc1-4e87-b331-03dfc04670f6 Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Creating offline snapshot 33db70f3-664a-490a-ab11-f1d82b1e9862 of volume 9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c347f3dd-3d96-428a-86e2-ab56601a6332]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-82249e75-8dbc-479a-a823-6e5ff96fb585 tempest-GroupSnapshotsTest-331254160 None] group_snapshot 93e6981f-ec1b-4a3e-a28b-0226fd88ef2e: created successfully Sep 07 16:51:09 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 Sep 07 16:51:09 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:09 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164" returned: 0 in 0.401s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:09 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 1G Sep 07 16:51:09 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] group_snapshot 93e6981f-ec1b-4a3e-a28b-0226fd88ef2e: deleting Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] group_snapshot 93e6981f-ec1b-4a3e-a28b-0226fd88ef2e: deleting {{(pid=87492) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 16:51:10 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 1G" returned: 0 in 0.475s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:10 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 Sep 07 16:51:10 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-e2b84cd0-97fd-4cd4-a085-ac95341cac75" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-e2b84cd0-97fd-4cd4-a085-ac95341cac75" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Deleting offline snapshot e2b84cd0-97fd-4cd4-a085-ac95341cac75 of volume ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] snapshot_file for this snap is: volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c092047-c006-485b-8926-ac1c5d5036f9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:10 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 Sep 07 16:51:10 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:10 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:10 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 is being set with open permissions: ugo+rw Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:10 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 Sep 07 16:51:10 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:10 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75" returned: 0 in 0.406s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5145b9e7-b23c-4a58-b582-04c35b045ece]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:10 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862" returned: 0 in 0.292s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:10 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.info Sep 07 16:51:10 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:10 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d Sep 07 16:51:10 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:10 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.info" returned: 0 in 0.290s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:10 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.info is being set with open permissions: ugo+rw Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:10 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" returned: 0 in 0.413s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:11 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.info Sep 07 16:51:11 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:11 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 Sep 07 16:51:11 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:11 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.info" returned: 0 in 0.372s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Acquiring lock "cinder-quobyte-08e11008-ebc1-4e87-b331-03dfc04670f6" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-08e11008-ebc1-4e87-b331-03dfc04670f6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] snapshot: 33db70f3-664a-490a-ab11-f1d82b1e9862, volume: 08e11008-ebc1-4e87-b331-03dfc04670f6, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb7cee1-70a5-4212-90a5-1415b218e534]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:11 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75" returned: 0 in 0.436s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:11 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75 Sep 07 16:51:11 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:11 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 Sep 07 16:51:11 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:11 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d.e2b84cd0-97fd-4cd4-a085-ac95341cac75" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-e2b84cd0-97fd-4cd4-a085-ac95341cac75" released by "_delete_snapshot" :: held 1.676s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" released by "delete_snapshot" :: held 1.701s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:11 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862" returned: 0 in 0.409s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9142b2f9-acb5-4157-b8b3-86f37fef1164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a776c0-b4fa-48cc-8fe5-64201dae3bc9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:11 devstack cinder-volume[87492]: WARNING cinder.quota [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1598104591 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1598104591, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:51:11 devstack cinder-volume[87492]: WARNING cinder.quota [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1598104591 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1598104591, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:51:11 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['ca75a17c-5884-4d1a-9c1e-d1c9386c7176', 'dcd5ade4-3bda-4bbb-a1fd-78c4157f043c', '89e4b9ea-d8c1-4342-a215-be588c664656', '2bb8bdc9-c6f8-4161-84d5-97b05426fa91'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:11 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 Sep 07 16:51:11 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-abb5dfc9-2964-47fd-8cc0-6f20bdaccc25 tempest-GroupSnapshotsTest-331254160 None] group_snapshot 93e6981f-ec1b-4a3e-a28b-0226fd88ef2e: deleted successfully Sep 07 16:51:12 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164" returned: 0 in 0.422s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:12 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 Sep 07 16:51:12 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-4c748942-3f0c-445c-9c2c-84fc8e3fa130 req-beee72a6-b622-4681-8ac4-23da48a2a273 tempest-TestShelveInstance-713532939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "cinder-quobyte-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c804a14a-4df1-4ee9-b7b0-67ef4102215e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:12 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d Sep 07 16:51:12 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:13 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" returned: 0 in 0.910s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:13 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d Sep 07 16:51:13 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:14 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" returned: 0 in 0.561s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Lock "cinder-quobyte-ffcab0a1-0914-457e-ac9f-66e7b67a5d8d" released by "delete_volume" :: held 1.574s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['ef175487-05fd-4380-b4e9-174b025b1835'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:14 devstack cinder-volume[87492]: WARNING cinder.quota [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1598104591 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1598104591, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Created reservations ['2c7e44d5-dbbe-4b27-bde1-17e87ae3d456', 'f93dd51e-5a20-44d8-babc-19ba9a2108de', '970e46a5-0c3e-47b1-a27b-95145f641f26', 'cfbcd902-c1ab-44fa-88ff-d91217ff2ab0'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:14 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:14 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:15 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.513s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:15 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:15 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3446a404-0665-4e46-bba9-66ea73faf841 tempest-GroupSnapshotsTest-331254160 None] Delete group completed successfully. Sep 07 16:51:17 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6" returned: 0 in 5.422s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:17 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:51:17 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Converted 1024.00 MB image at 188.82 MB/s Sep 07 16:51:17 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 is being set with open permissions: ugo+rw Sep 07 16:51:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:17 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 Sep 07 16:51:17 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:17 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6" returned: 0 in 0.272s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-08e11008-ebc1-4e87-b331-03dfc04670f6" released by "_copy_volume_from_snapshot" :: held 6.609s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Acquiring lock "cinder-quobyte-33db70f3-664a-490a-ab11-f1d82b1e9862" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-33db70f3-664a-490a-ab11-f1d82b1e9862" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Deleting offline snapshot 33db70f3-664a-490a-ab11-f1d82b1e9862 of volume 9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] snapshot_file for this snap is: volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7d574e-f5c9-48f4-9893-250dc5232ab1]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:18 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 Sep 07 16:51:18 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:18 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862" returned: 0 in 0.374s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9142b2f9-acb5-4157-b8b3-86f37fef1164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033c369-a9eb-4ea2-9ad5-9e260ee55343]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:18 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 Sep 07 16:51:18 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:19 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164" returned: 0 in 0.607s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:19 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 Sep 07 16:51:19 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:19 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862" returned: 0 in 0.360s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:19 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862 Sep 07 16:51:19 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:19 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164.33db70f3-664a-490a-ab11-f1d82b1e9862" returned: 0 in 0.270s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-33db70f3-664a-490a-ab11-f1d82b1e9862" released by "_delete_snapshot" :: held 1.706s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.685s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.826s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3dc382-d69a-452f-a7b4-8962dd22a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e11008-ebc1-4e87-b331-03dfc04670f6', 'volume_size': 2, 'source_volid': '9142b2f9-acb5-4157-b8b3-86f37fef1164', 'source_volstatus': 'available'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2644f4-e5a9-4ffc-9cd9-e767144b6285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Creating offline snapshot bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d of volume de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:51:19 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Volume volume-08e11008-ebc1-4e87-b331-03dfc04670f6 (08e11008-ebc1-4e87-b331-03dfc04670f6): created successfully Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2644f4-e5a9-4ffc-9cd9-e767144b6285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Flow 'volume_create_manager' (fc3a9c75-4e8a-4543-9b3b-a0057ed303c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4fcef-c7a4-4f15-91d7-032a86658d72]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ddd6df5d-d3a5-4a7d-8db0-023a490df78f tempest-VolumesCloneTest-5748602 None] Created volume successfully. Sep 07 16:51:19 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 Sep 07 16:51:19 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:20 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955" returned: 0 in 0.422s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:20 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d 1G Sep 07 16:51:20 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Acquiring lock "cinder-08e11008-ebc1-4e87-b331-03dfc04670f6-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Lock "cinder-08e11008-ebc1-4e87-b331-03dfc04670f6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Acquiring lock "cinder-quobyte-08e11008-ebc1-4e87-b331-03dfc04670f6" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-08e11008-ebc1-4e87-b331-03dfc04670f6" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32465ca-39b3-46e3-ae2f-ff618221cc8b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:20 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d 1G" returned: 0 in 0.515s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:20 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d Sep 07 16:51:20 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:20 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 Sep 07 16:51:20 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:21 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" returned: 0 in 0.312s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:21 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d is being set with open permissions: ugo+rw Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:21 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d Sep 07 16:51:21 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:21 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6" returned: 0 in 0.425s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:21 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6 Sep 07 16:51:21 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:21 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:21 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.info Sep 07 16:51:21 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:21 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-08e11008-ebc1-4e87-b331-03dfc04670f6" returned: 0 in 0.303s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-08e11008-ebc1-4e87-b331-03dfc04670f6" released by "delete_volume" :: held 0.783s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Created reservations ['bb727e64-d7fe-4841-86ed-f3ea1b601ffc', 'a3e6cdfd-36fe-4607-af9e-59da802dd2a2', '1e643995-87da-4a04-b9f5-867496cd1f3e', 'e7368a58-2f0f-44ed-bb78-9735abecabc6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:21 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:21 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:21 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.info" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:21 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.info is being set with open permissions: ugo+rw Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:21 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.info Sep 07 16:51:21 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:21 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Acquiring lock "cinder-9142b2f9-acb5-4157-b8b3-86f37fef1164-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.349s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:21 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Deleted volume successfully. Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Lock "cinder-9142b2f9-acb5-4157-b8b3-86f37fef1164-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2f723b96-a9d3-4bc4-913c-e0306fd62558 tempest-VolumesCloneTest-5748602 None] Lock "cinder-08e11008-ebc1-4e87-b331-03dfc04670f6-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:22 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Acquiring lock "cinder-quobyte-9142b2f9-acb5-4157-b8b3-86f37fef1164" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.info" returned: 0 in 0.362s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-4c748942-3f0c-445c-9c2c-84fc8e3fa130 req-beee72a6-b622-4681-8ac4-23da48a2a273 tempest-TestShelveInstance-713532939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.654s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-4c748942-3f0c-445c-9c2c-84fc8e3fa130 req-beee72a6-b622-4681-8ac4-23da48a2a273 tempest-TestShelveInstance-713532939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-9142b2f9-acb5-4157-b8b3-86f37fef1164" acquired by "delete_volume" :: waited 0.055s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a6a314b6-2b22-4eac-b827-78cb0303cf79 tempest-SnapshotMetadataTestJSON-232477863 None] Create snapshot completed successfully Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2accc559-fd6a-47ad-9845-f77a97cbd71d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-4c748942-3f0c-445c-9c2c-84fc8e3fa130 req-beee72a6-b622-4681-8ac4-23da48a2a273 tempest-TestShelveInstance-713532939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-fb3d724b-3cd4-431c-8396-48a0889afade', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4da8d5c4-2f14-4cd1-9dbd-6f19395af3f2', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:51:22 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 Sep 07 16:51:22 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-4c748942-3f0c-445c-9c2c-84fc8e3fa130 req-beee72a6-b622-4681-8ac4-23da48a2a273 tempest-TestShelveInstance-713532939 None] attachment_update completed successfully. Sep 07 16:51:22 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164" returned: 0 in 0.469s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:22 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164 Sep 07 16:51:22 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b292c27e-d6df-46fc-9ebd-96ec0f2d65ba tempest-GroupSnapshotsV319Test-559573044 None] Group tempest-GroupSnapshotsV319Test-Group-1284626050: creating Sep 07 16:51:23 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9142b2f9-acb5-4157-b8b3-86f37fef1164" returned: 0 in 0.376s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b292c27e-d6df-46fc-9ebd-96ec0f2d65ba tempest-GroupSnapshotsV319Test-559573044 None] Group tempest-GroupSnapshotsV319Test-Group-1284626050: created successfully Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Lock "cinder-quobyte-9142b2f9-acb5-4157-b8b3-86f37fef1164" released by "delete_volume" :: held 0.978s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b292c27e-d6df-46fc-9ebd-96ec0f2d65ba tempest-GroupSnapshotsV319Test-559573044 None] Create group completed successfully. Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Created reservations ['1067bab2-d267-45c3-b711-ee03af4abfbc', '15008210-01c4-4d44-bb96-550894938802', '403b631a-f5ec-4581-b380-6c9f3e5b98ed', '08a6e84d-7701-49e3-9460-9c8c23f111ea'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:23 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:23 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:23 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Deleted volume successfully. Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1be93063-0bc7-42c5-ad25-26d6db54f296 tempest-VolumesCloneTest-5748602 None] Lock "cinder-9142b2f9-acb5-4157-b8b3-86f37fef1164-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "cinder-bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "cinder-quobyte-de6a8f18-ba45-410c-94aa-7e0530fc3955" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-quobyte-de6a8f18-ba45-410c-94aa-7e0530fc3955" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "cinder-quobyte-bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-quobyte-bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Deleting offline snapshot bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d of volume de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:51:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] snapshot_file for this snap is: volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:51:24 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e945a3-3c46-438f-9a33-0c04ab437922]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:24 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d Sep 07 16:51:24 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:24 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" returned: 0 in 0.540s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de6a8f18-ba45-410c-94aa-7e0530fc3955(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:51:24 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4459eaf4-339d-4b25-b375-f8fbaf6cd0cb]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:24 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 Sep 07 16:51:24 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:24 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Flow 'volume_create_manager' (987fefb8-8b35-4205-925d-db1a8ee958fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15956ba1-1660-4f28-96a7-7146c4e0fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15956ba1-1660-4f28-96a7-7146c4e0fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295035406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74cdae5c-004c-413f-8da4-489fa1ceec64,host='devstack@QuobyteHD#QuobyteHD',id=b2fd3068-863b-494f-8dfe-7ddd759dc209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac9ecbd2be4fafae07ef4d2ec30fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:25Z,use_quota=True,user_id='4980d395682340a885825d3ebdd51c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f2af7f-543b-4c26-bded-98d93bce0600),volume_type_id=c9f2af7f-543b-4c26-bded-98d93bce0600)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d4ef34-f2fd-4a8e-a6b2-015404575239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d4ef34-f2fd-4a8e-a6b2-015404575239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5344a153-d2ae-4959-80df-3243d1b2670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5344a153-d2ae-4959-80df-3243d1b2670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2fd3068-863b-494f-8dfe-7ddd759dc209', 'volume_name': 'volume-b2fd3068-863b-494f-8dfe-7ddd759dc209', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85edabb-4004-4edd-b14b-b32f6c507e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85edabb-4004-4edd-b14b-b32f6c507e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67272c82-a404-485f-9fb5-784fbab89ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Volume b2fd3068-863b-494f-8dfe-7ddd759dc209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2fd3068-863b-494f-8dfe-7ddd759dc209', 'volume_size': 1} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74cdae5c-004c-413f-8da4-489fa1ceec64,created_at=2026-09-07T14:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295035406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74cdae5c-004c-413f-8da4-489fa1ceec64,host='devstack@QuobyteHD#QuobyteHD',id=b2fd3068-863b-494f-8dfe-7ddd759dc209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeac9ecbd2be4fafae07ef4d2ec30fc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:25Z,use_quota=True,user_id='4980d395682340a885825d3ebdd51c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f2af7f-543b-4c26-bded-98d93bce0600),volume_type_id=c9f2af7f-543b-4c26-bded-98d93bce0600)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Creating volume b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:25 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:25 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955" returned: 0 in 0.511s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:25 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 1073741824 Sep 07 16:51:25 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:25 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d Sep 07 16:51:25 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:25 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" returned: 0 in 0.552s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:25 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d Sep 07 16:51:25 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:25 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 1073741824" returned: 0 in 0.687s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:25 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 Sep 07 16:51:25 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:26 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955.bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" returned: 0 in 0.498s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-quobyte-bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d" released by "_delete_snapshot" :: held 2.319s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-quobyte-de6a8f18-ba45-410c-94aa-7e0530fc3955" released by "delete_snapshot" :: held 2.358s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:26 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209" returned: 0 in 0.547s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67272c82-a404-485f-9fb5-784fbab89ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2fd3068-863b-494f-8dfe-7ddd759dc209', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c3921c-1a3f-44f4-a3b8-e3079152fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Created reservations ['d8775ce1-855c-4a21-a0c3-69c398583970', 'af26e76c-1c17-44cc-a4dd-c640822ac1cb', '1efca3cf-7eb7-4d16-973b-54367b5064f1', '9c98df00-1763-42b3-9631-4641a98409ff'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Volume volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 (b2fd3068-863b-494f-8dfe-7ddd759dc209): created successfully Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c3921c-1a3f-44f4-a3b8-e3079152fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Flow 'volume_create_manager' (987fefb8-8b35-4205-925d-db1a8ee958fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3f522861-4829-4325-b7f7-ee87f266ada7 tempest-GroupSnapshotsV319Test-559573044 None] Created volume successfully. Sep 07 16:51:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Delete snapshot completed successfully. Sep 07 16:51:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b042187e-f52d-42fc-97cb-7aa4de40a7e5 tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-bcbbb7ee-7b11-4c71-9426-bc1d3cc18b2d-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "cinder-de6a8f18-ba45-410c-94aa-7e0530fc3955-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-de6a8f18-ba45-410c-94aa-7e0530fc3955-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "cinder-quobyte-de6a8f18-ba45-410c-94aa-7e0530fc3955" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-quobyte-de6a8f18-ba45-410c-94aa-7e0530fc3955" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a99f20-9c7a-4420-b1c2-edac750f304f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:27 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 Sep 07 16:51:27 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] GroupSnapshot 1dc6d331-d785-450e-b936-3587c56a7520: creating. Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Group snapshot 1dc6d331-d785-450e-b936-3587c56a7520: creating. {{(pid=87492) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:28 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955" returned: 0 in 0.664s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Creating offline snapshot 36afb939-627d-49ee-8f69-6364550663b5 of volume b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:51:28 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955 Sep 07 16:51:28 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2b147-2a87-400d-8447-2e6fb0ce8498]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:28 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 Sep 07 16:51:28 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:28 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-de6a8f18-ba45-410c-94aa-7e0530fc3955" returned: 0 in 0.413s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-quobyte-de6a8f18-ba45-410c-94aa-7e0530fc3955" released by "delete_volume" :: held 1.193s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Created reservations ['0e9199f1-9804-4415-affe-a5396060ad18', 'cdc64a17-fbc5-407f-9ede-ea547da8fe2c', 'cec1fa48-ed53-4665-bbd3-680d47a60da4', '3a7759e4-48c4-4a4f-b7ee-91a53f3dcd2a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:28 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209" returned: 0 in 0.637s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:28 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:28 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:29 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 1G Sep 07 16:51:29 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:29 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.384s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:29 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Deleted volume successfully. Sep 07 16:51:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-15fa0d92-32c6-455b-8e7d-92bd265a3f5f tempest-SnapshotMetadataTestJSON-232477863 None] Lock "cinder-de6a8f18-ba45-410c-94aa-7e0530fc3955-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:29 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 1G" returned: 0 in 0.537s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:29 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 Sep 07 16:51:29 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:29 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5" returned: 0 in 0.349s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:29 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:51:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:29 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 Sep 07 16:51:29 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:30 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:30 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.info Sep 07 16:51:30 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:30 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.info" returned: 0 in 0.382s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:30 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:30 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.info Sep 07 16:51:30 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Flow 'volume_create_manager' (964b0ee6-be24-40ad-85df-929cc487d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423ea00b-a4bc-4662-95cb-d402c89e756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423ea00b-a4bc-4662-95cb-d402c89e756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-872797462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766b09a7-648e-498d-8248-cae76e3be727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b57aa56d9814c4f92aff3dff1b115b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:31Z,use_quota=True,user_id='71533117c93446f9b9ddac3cc6bfbfb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b492f7-5fd6-4904-87f0-b032e793e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b492f7-5fd6-4904-87f0-b032e793e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85824a4e-c0c2-46fb-96b7-d51f74559b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85824a4e-c0c2-46fb-96b7-d51f74559b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766b09a7-648e-498d-8248-cae76e3be727', 'volume_name': 'volume-766b09a7-648e-498d-8248-cae76e3be727', 'volume_size': 2}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37321c6c-3f7d-4088-9216-a22d1846b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37321c6c-3f7d-4088-9216-a22d1846b215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c92d3cb-9118-4ff7-9e7d-1b6ab02f3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:30 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Volume 766b09a7-648e-498d-8248-cae76e3be727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766b09a7-648e-498d-8248-cae76e3be727', 'volume_size': 2} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:30 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.info" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-872797462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766b09a7-648e-498d-8248-cae76e3be727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b57aa56d9814c4f92aff3dff1b115b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:31Z,use_quota=True,user_id='71533117c93446f9b9ddac3cc6bfbfb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Creating volume 766b09a7-648e-498d-8248-cae76e3be727 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:30 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 2147483648 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:31 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 2147483648 Sep 07 16:51:31 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c4e5ca75-045f-4baa-969b-1e4352964d16 tempest-GroupSnapshotsV319Test-559573044 None] group_snapshot 1dc6d331-d785-450e-b936-3587c56a7520: created successfully Sep 07 16:51:31 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 2147483648" returned: 0 in 0.976s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:32 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 Sep 07 16:51:32 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] group_snapshot 1dc6d331-d785-450e-b936-3587c56a7520: deleting Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] group_snapshot 1dc6d331-d785-450e-b936-3587c56a7520: deleting {{(pid=87492) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Acquiring lock "cinder-quobyte-b2fd3068-863b-494f-8dfe-7ddd759dc209" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Lock "cinder-quobyte-b2fd3068-863b-494f-8dfe-7ddd759dc209" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Acquiring lock "cinder-quobyte-36afb939-627d-49ee-8f69-6364550663b5" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Lock "cinder-quobyte-36afb939-627d-49ee-8f69-6364550663b5" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Deleting offline snapshot 36afb939-627d-49ee-8f69-6364550663b5 of volume b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] snapshot_file for this snap is: volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0036523-d32d-41d8-8af3-ad5df539e38c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:32 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727" returned: 0 in 0.605s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:32 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 Sep 07 16:51:32 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c92d3cb-9118-4ff7-9e7d-1b6ab02f3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766b09a7-648e-498d-8248-cae76e3be727', 'volume_size': 2}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161e40cd-a35b-43b8-b080-b1e4bb75870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Volume volume-766b09a7-648e-498d-8248-cae76e3be727 (766b09a7-648e-498d-8248-cae76e3be727): created successfully Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161e40cd-a35b-43b8-b080-b1e4bb75870c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Flow 'volume_create_manager' (964b0ee6-be24-40ad-85df-929cc487d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0579e5d3-9df5-4e96-9604-4043a75906e4 tempest-VolumesCloneNegativeTest-315390244 None] Created volume successfully. Sep 07 16:51:33 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5" returned: 0 in 0.579s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2fd3068-863b-494f-8dfe-7ddd759dc209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc673876-5c67-4100-a787-9f9875603700]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:33 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 Sep 07 16:51:33 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:33 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:33 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:33 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209" returned: 0 in 0.458s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:33 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 Sep 07 16:51:33 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:33 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.393s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 28 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:51:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:51:34 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5" returned: 0 in 0.477s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:34 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5 Sep 07 16:51:34 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Acquiring lock "cinder-766b09a7-648e-498d-8248-cae76e3be727-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Lock "cinder-766b09a7-648e-498d-8248-cae76e3be727-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Acquiring lock "cinder-quobyte-766b09a7-648e-498d-8248-cae76e3be727" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Lock "cinder-quobyte-766b09a7-648e-498d-8248-cae76e3be727" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8e7bb7-e8be-44ea-b4d9-78f8b9e0061f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:34 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209.36afb939-627d-49ee-8f69-6364550663b5" returned: 0 in 0.359s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Lock "cinder-quobyte-36afb939-627d-49ee-8f69-6364550663b5" released by "_delete_snapshot" :: held 2.022s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Lock "cinder-quobyte-b2fd3068-863b-494f-8dfe-7ddd759dc209" released by "delete_snapshot" :: held 2.079s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:34 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 Sep 07 16:51:34 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:34 devstack cinder-volume[87492]: WARNING cinder.quota [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1723021499 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1723021499, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:51:34 devstack cinder-volume[87492]: WARNING cinder.quota [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1723021499 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1723021499, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] Created reservations ['b716805f-0765-4cd8-b15c-bc1956c0748d', '7fe7c245-e816-4ac3-b2ea-ea15cad2950c', '006c6a6a-11cc-4305-90db-d36b6dfda402', 'c32384df-4925-4d57-96cb-68695c896d8e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fe28a646-4a48-412b-a9be-51f4e2acab7f tempest-GroupSnapshotsV319Test-559573044 None] group_snapshot 1dc6d331-d785-450e-b936-3587c56a7520: deleted successfully Sep 07 16:51:34 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727" returned: 0 in 0.421s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:34 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727 Sep 07 16:51:34 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Acquiring lock "cinder-quobyte-b2fd3068-863b-494f-8dfe-7ddd759dc209" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Lock "cinder-quobyte-b2fd3068-863b-494f-8dfe-7ddd759dc209" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6ef32d-fce9-4462-9df5-b6a58dd761e6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:35 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-766b09a7-648e-498d-8248-cae76e3be727" returned: 0 in 0.375s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Lock "cinder-quobyte-766b09a7-648e-498d-8248-cae76e3be727" released by "delete_volume" :: held 0.856s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Created reservations ['d7f262f7-b149-4948-89f8-dac3bcedf65d', '6a8f8e33-b958-4d98-adac-51f31b8530d9', '899660ab-36e1-42b3-a72d-bcda33ade5d3', '0e300163-fef8-45dc-add2-28f734ad22de'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:35 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 Sep 07 16:51:35 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:35 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:35 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:35 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209" returned: 0 in 0.558s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:35 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209 Sep 07 16:51:35 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:35 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.299s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:35 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Deleted volume successfully. Sep 07 16:51:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c8607bff-c09c-4b82-8c35-23a2c8894608 tempest-VolumesCloneNegativeTest-315390244 None] Lock "cinder-766b09a7-648e-498d-8248-cae76e3be727-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:36 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-b2fd3068-863b-494f-8dfe-7ddd759dc209" returned: 0 in 0.348s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Lock "cinder-quobyte-b2fd3068-863b-494f-8dfe-7ddd759dc209" released by "delete_volume" :: held 0.979s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Created reservations ['81543c17-885e-4206-84f1-6c8a9819cdd6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:36 devstack cinder-volume[87492]: WARNING cinder.quota [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1723021499 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1723021499, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Created reservations ['5bbbb96c-5b1d-41f1-807e-83b8e4e4ee4c', '75df9b3a-72f1-439e-a2d2-50cb3d169dd1', '3d65d9e5-346b-4257-ad28-7d74622443a8', '5e0b3064-6c77-49af-91aa-572f7f0af8af'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:36 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:36 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:36 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.526s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:36 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-31c51263-72dc-491c-a315-735f5ff56c4e tempest-GroupSnapshotsV319Test-559573044 None] Delete group completed successfully. Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Flow 'volume_create_manager' (f1d647aa-21b8-47ce-85ad-ea110c7df50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c355817c-b814-49c6-8b96-1b051b90ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c355817c-b814-49c6-8b96-1b051b90ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-831019254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17446637-de25-44b2-95a0-2a151f872880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb081fa9574c4be5a4a1e58d33f48122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:37Z,use_quota=True,user_id='f0b89691c6d14ce295b829d5922e9418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35497a1c-7808-4503-b8d4-ab8042c66a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35497a1c-7808-4503-b8d4-ab8042c66a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19af77a-25ca-4953-8d19-9309fc59d3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19af77a-25ca-4953-8d19-9309fc59d3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17446637-de25-44b2-95a0-2a151f872880', 'volume_name': 'volume-17446637-de25-44b2-95a0-2a151f872880', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c41186-264c-4b7f-9108-434437d340f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c41186-264c-4b7f-9108-434437d340f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d67ac7c-e385-4a3f-ae53-2350df8b6600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:37 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Volume 17446637-de25-44b2-95a0-2a151f872880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17446637-de25-44b2-95a0-2a151f872880', 'volume_size': 1} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-831019254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17446637-de25-44b2-95a0-2a151f872880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb081fa9574c4be5a4a1e58d33f48122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:37Z,use_quota=True,user_id='f0b89691c6d14ce295b829d5922e9418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Creating volume 17446637-de25-44b2-95a0-2a151f872880 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:37 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:37 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 1073741824 Sep 07 16:51:37 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:37 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 1073741824" returned: 0 in 0.530s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:37 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 Sep 07 16:51:37 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:38 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880" returned: 0 in 0.320s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d67ac7c-e385-4a3f-ae53-2350df8b6600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17446637-de25-44b2-95a0-2a151f872880', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af85ae16-4704-4809-84be-76978864741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:38 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Volume volume-17446637-de25-44b2-95a0-2a151f872880 (17446637-de25-44b2-95a0-2a151f872880): created successfully Sep 07 16:51:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af85ae16-4704-4809-84be-76978864741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Flow 'volume_create_manager' (f1d647aa-21b8-47ce-85ad-ea110c7df50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:38 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5af84255-c3b5-402a-9db0-e2186ab32e90 tempest-VolumesTransfersV357Test-2124707121 None] Created volume successfully. Sep 07 16:51:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6164709d-0508-4da1-844d-7db79b129676 tempest-VolumesTransfersV357Test-700192638 None] Transfer volume completed successfully. Sep 07 16:51:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Acquiring lock "cinder-17446637-de25-44b2-95a0-2a151f872880-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-17446637-de25-44b2-95a0-2a151f872880-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Acquiring lock "cinder-quobyte-17446637-de25-44b2-95a0-2a151f872880" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-quobyte-17446637-de25-44b2-95a0-2a151f872880" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:41 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[700e174f-0138-4f98-bfb4-5f6969f55ef2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:42 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 Sep 07 16:51:42 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:42 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880" returned: 0 in 0.553s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:42 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880 Sep 07 16:51:42 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:42 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17446637-de25-44b2-95a0-2a151f872880" returned: 0 in 0.382s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-quobyte-17446637-de25-44b2-95a0-2a151f872880" released by "delete_volume" :: held 0.991s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:42 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Created reservations ['f9436bbd-4318-4526-a7dc-16b08e082068', 'b13b9127-e968-4bb4-ae3d-dd872dd02697', 'c5c75dd4-07e0-449d-9864-a398a27fb1e9', '1f2c3669-f5b6-4114-8333-c7d310755dd6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:43 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:43 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:43 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.341s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Deleted volume successfully. Sep 07 16:51:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-03439d13-946c-4a0b-a43c-26d77936c2d6 tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-17446637-de25-44b2-95a0-2a151f872880-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1e3f7ce9-e2d3-4a7c-ab2c-271eb9f96e24 tempest-GroupsV320Test-2089458537 None] Group tempest-GroupsV320Test-Group-1724297410: creating Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Flow 'volume_create_manager' (b3af935f-04f3-4893-bce8-f9a70ba4eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a00e1bc-c26f-48e4-9628-5c51c4233ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1e3f7ce9-e2d3-4a7c-ab2c-271eb9f96e24 tempest-GroupsV320Test-2089458537 None] Group tempest-GroupsV320Test-Group-1724297410: created successfully Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a00e1bc-c26f-48e4-9628-5c51c4233ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2098441613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35ffca1-50d3-4123-86f3-fb5dd84f1da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb081fa9574c4be5a4a1e58d33f48122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:45Z,use_quota=True,user_id='f0b89691c6d14ce295b829d5922e9418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0290fcc5-0a9e-4876-954f-e8aab0f4037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0290fcc5-0a9e-4876-954f-e8aab0f4037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f1272a-6496-4bc8-99c2-5427c82fca59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f1272a-6496-4bc8-99c2-5427c82fca59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e35ffca1-50d3-4123-86f3-fb5dd84f1da8', 'volume_name': 'volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b268823c-8d29-4cf5-acad-65ba1b551d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b268823c-8d29-4cf5-acad-65ba1b551d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4c9406-5f27-4622-8a66-39ffd897d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:45 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Volume e35ffca1-50d3-4123-86f3-fb5dd84f1da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8', 'volume_size': 1} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2098441613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e35ffca1-50d3-4123-86f3-fb5dd84f1da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb081fa9574c4be5a4a1e58d33f48122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:45Z,use_quota=True,user_id='f0b89691c6d14ce295b829d5922e9418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Creating volume e35ffca1-50d3-4123-86f3-fb5dd84f1da8 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:45 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1e3f7ce9-e2d3-4a7c-ab2c-271eb9f96e24 tempest-GroupsV320Test-2089458537 None] Create group completed successfully. Sep 07 16:51:45 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 1073741824 Sep 07 16:51:45 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:45 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 1073741824" returned: 0 in 0.487s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:INSERT=49,cinder:UPDATE=181,cinder:SELECT=149,cinder:DELETE=10 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:45 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 Sep 07 16:51:45 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:45 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4c9406-5f27-4622-8a66-39ffd897d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4652db71-9f35-4602-b9d5-3a33631c3202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:45 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Volume volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 (e35ffca1-50d3-4123-86f3-fb5dd84f1da8): created successfully Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4652db71-9f35-4602-b9d5-3a33631c3202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Flow 'volume_create_manager' (b3af935f-04f3-4893-bce8-f9a70ba4eaac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-314cdde3-eab0-4490-b561-e4a96ee3737c tempest-VolumesTransfersV357Test-2124707121 None] Created volume successfully. Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Created reservations ['14ea0e2a-16da-4016-96f0-7d2b2070e1e8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:46 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:46 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:46 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:46 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d1f27b3c-af99-4a8c-8601-f303ab51c82d tempest-GroupsV320Test-2089458537 None] Delete group completed successfully. Sep 07 16:51:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Acquiring lock "cinder-e35ffca1-50d3-4123-86f3-fb5dd84f1da8-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-e35ffca1-50d3-4123-86f3-fb5dd84f1da8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Acquiring lock "cinder-quobyte-e35ffca1-50d3-4123-86f3-fb5dd84f1da8" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:51:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-quobyte-e35ffca1-50d3-4123-86f3-fb5dd84f1da8" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:51:47 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f083a2-5e78-400b-a2d1-17e42ff7139f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:47 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 Sep 07 16:51:47 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:48 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8" returned: 0 in 0.476s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:48 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8 Sep 07 16:51:48 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:48 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e35ffca1-50d3-4123-86f3-fb5dd84f1da8" returned: 0 in 0.363s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-quobyte-e35ffca1-50d3-4123-86f3-fb5dd84f1da8" released by "delete_volume" :: held 0.924s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Created reservations ['d9d4f2a6-ab19-4a9f-b9dd-f5ca36d2aa1b', 'b142ed72-5d3a-4f92-aafc-d9c79a9360cb', '3b8d63e8-4e72-41b1-bc2a-360267e160d5', 'fb4963fc-d9b6-4323-8ee8-51c091e9713b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:48 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:51:48 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:49 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.321s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:49 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:49 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Deleted volume successfully. Sep 07 16:51:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8abc6c0f-b8c6-41bd-8306-ea23a6acf01a tempest-VolumesTransfersV357Test-1330285450 None] Lock "cinder-e35ffca1-50d3-4123-86f3-fb5dd84f1da8-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:51:50 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=184,cinder:UPDATE=177,cinder:INSERT=53,cinder:DELETE=10 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Flow 'volume_create_manager' (92b060ea-5da6-499f-a419-616d75a64a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aecb310-af71-44a1-8894-56911c74a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aecb310-af71-44a1-8894-56911c74a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1490717139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e0bb83-d03d-4cca-b18a-bc026be70ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4678f7eaf14d3b8b976f63b9a80380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:58Z,use_quota=True,user_id='afe6e31fede64abb91d0d861dbdb1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd51acd0-049c-41af-9dd1-e4142a2fc482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd51acd0-049c-41af-9dd1-e4142a2fc482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7853c5fe-a420-48f6-ba6d-1e09d7db7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7853c5fe-a420-48f6-ba6d-1e09d7db7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e0bb83-d03d-4cca-b18a-bc026be70ddc', 'volume_name': 'volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbd0240-06eb-41ae-88bf-63632ef47e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdbd0240-06eb-41ae-88bf-63632ef47e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2d9983-d0d8-4696-9928-aa24fc8abe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc', 'volume_size': 1} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1490717139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e0bb83-d03d-4cca-b18a-bc026be70ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4678f7eaf14d3b8b976f63b9a80380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:58Z,use_quota=True,user_id='afe6e31fede64abb91d0d861dbdb1324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Creating volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:51:58 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:58 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc 1073741824 Sep 07 16:51:58 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:58 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc 1073741824" returned: 0 in 0.611s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:59 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc Sep 07 16:51:59 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Flow 'volume_create_manager' (9d281769-7e40-4c49-b8e1-efba56184af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad613519-76d9-407a-b5d8-65c5d27065b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad613519-76d9-407a-b5d8-65c5d27065b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1798081282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a2789d-0e25-4ba4-8c3e-b0d36e713264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a121330faef43fca3b1d31c4238a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:59Z,use_quota=True,user_id='5890b14fc4cc468c80a82cf5351fd635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca21ef6-b3f6-420f-8f3c-1251354976f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ca21ef6-b3f6-420f-8f3c-1251354976f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60dcdbe-afc7-4c7c-a30d-6e3289817e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:51:59 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2d9983-d0d8-4696-9928-aa24fc8abe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154bd572-a3a8-4fdf-81ca-6454351d54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:59 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Volume volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc (c6e0bb83-d03d-4cca-b18a-bc026be70ddc): created successfully Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154bd572-a3a8-4fdf-81ca-6454351d54be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Flow 'volume_create_manager' (92b060ea-5da6-499f-a419-616d75a64a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:51:59 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fb8074f3-6889-41ff-956e-f9c7e46ec984 tempest-SnapshotsActionsTest-1399773043 None] Created volume successfully. Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60dcdbe-afc7-4c7c-a30d-6e3289817e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17a2789d-0e25-4ba4-8c3e-b0d36e713264', 'volume_name': 'volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77f929d-dca5-46ad-9702-7f6d59928b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77f929d-dca5-46ad-9702-7f6d59928b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a805bccc-ff1b-4ffc-836b-83960ea33b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:51:59 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Volume 17a2789d-0e25-4ba4-8c3e-b0d36e713264: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Trying to clone 17a2789d-0e25-4ba4-8c3e-b0d36e713264 from image cd35955c-2cfe-436b-a709-f0de1afb8856 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:51:59 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Image download 20.69 MB at 20.69 MB/s Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c95a8cb-98fc-4462-b7d6-8de4349a53b6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:51:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:00 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD Sep 07 16:52:00 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:00 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 is fetched for user 5890b14fc4cc468c80a82cf5351fd635. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[12da8e34-48a4-4e8b-aecb-423fafadc9a5]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:00 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD Sep 07 16:52:00 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Creating offline snapshot 1be3c24e-9f77-4c0b-8722-77a7a83b4706 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e39793-c412-476b-86c2-7e3ffd568568]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:00 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc Sep 07 16:52:00 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:00 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:01 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" returned: 0 in 0.382s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:01 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 1G Sep 07 16:52:01 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:01 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 1G" returned: 0 in 0.463s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:01 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:01 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:01 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.327s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:01 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 is being set with open permissions: ugo+rw Sep 07 16:52:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:01 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:01 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:02 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.297s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:02 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.info Sep 07 16:52:02 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:02 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.info" returned: 0 in 0.276s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:02 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.info is being set with open permissions: ugo+rw Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:02 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.info Sep 07 16:52:02 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:02 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.info" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.017s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1798081282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a2789d-0e25-4ba4-8c3e-b0d36e713264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a121330faef43fca3b1d31c4238a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:51:59Z,use_quota=True,user_id='5890b14fc4cc468c80a82cf5351fd635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Creating volume 17a2789d-0e25-4ba4-8c3e-b0d36e713264 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:52:02 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:52:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:02 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 1073741824 Sep 07 16:52:02 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-89e9198e-9568-41e0-b7d8-7851ddff938d tempest-SnapshotsActionsTest-1399773043 None] Create snapshot completed successfully Sep 07 16:52:03 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 1073741824" returned: 0 in 0.462s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:03 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 Sep 07 16:52:03 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:03 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264" returned: 0 in 0.253s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Attempting download of cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume 17a2789d-0e25-4ba4-8c3e-b0d36e713264. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3457447-5ba7-4683-a705-166cf5377a5b]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_jv9ibbwm {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:03 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_jv9ibbwm Sep 07 16:52:03 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:03 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_jv9ibbwm" returned: 0 in 0.370s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_jv9ibbwm {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:04 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_jv9ibbwm Sep 07 16:52:04 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:04 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_jv9ibbwm" returned: 1 in 0.398s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_jv9ibbwm' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bd93d9-1613-4c64-9992-5f295d5c5958]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:04 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD Sep 07 16:52:04 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Creating offline snapshot c96fe2f4-488a-4a27-9c86-6ca800e7fb19 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a24949-0e12-4307-b64a-e2c31f64f40a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:04 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:04 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:04 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD" returned: 0 in 0.494s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] cd35955c-2cfe-436b-a709-f0de1afb8856 was qcow2, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:52:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:04 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 Sep 07 16:52:04 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:05 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.504s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:05 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 1G Sep 07 16:52:05 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:05 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 1G" returned: 0 in 0.689s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:05 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 Sep 07 16:52:05 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:06 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19" returned: 0 in 0.379s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:06 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 is being set with open permissions: ugo+rw Sep 07 16:52:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:06 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 Sep 07 16:52:06 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:06 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19" returned: 0 in 0.303s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b54aa0e5-a033-444f-85c0-3a53b5356ad2 tempest-SnapshotsActionsTest-1399773043 None] Create snapshot completed successfully Sep 07 16:52:07 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264" returned: 0 in 2.472s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_15q03sq5devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:52:07 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Converted 112.00 MB image at 45.28 MB/s Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:07 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 1G Sep 07 16:52:07 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:07 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 1G" returned: 0 in 0.462s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Downloaded image cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume 17a2789d-0e25-4ba4-8c3e-b0d36e713264 successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 for user 5890b14fc4cc468c80a82cf5351fd635 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Marking volume 17a2789d-0e25-4ba4-8c3e-b0d36e713264 as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Copying metadata from image cd35955c-2cfe-436b-a709-f0de1afb8856 to 17a2789d-0e25-4ba4-8c3e-b0d36e713264. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Creating volume glance metadata for volume 17a2789d-0e25-4ba4-8c3e-b0d36e713264 backed by image cd35955c-2cfe-436b-a709-f0de1afb8856 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-c96fe2f4-488a-4a27-9c86-6ca800e7fb19-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-c96fe2f4-488a-4a27-9c86-6ca800e7fb19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-c96fe2f4-488a-4a27-9c86-6ca800e7fb19" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c96fe2f4-488a-4a27-9c86-6ca800e7fb19" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Deleting offline snapshot c96fe2f4-488a-4a27-9c86-6ca800e7fb19 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] snapshot_file for this snap is: volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e61281-5e04-4cc0-a713-d0cf730cfe92]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a805bccc-ff1b-4ffc-836b-83960ea33b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7182494-4370-46cf-ba94-5ce144164bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:08 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Volume volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 (17a2789d-0e25-4ba4-8c3e-b0d36e713264): created successfully Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7182494-4370-46cf-ba94-5ce144164bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Flow 'volume_create_manager' (9d281769-7e40-4c49-b8e1-efba56184af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:08 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-58e202e3-88fe-4f43-9aff-d52e30e2952f tempest-VolumesExtendTest-1162037430 None] Created volume successfully. Sep 07 16:52:08 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 Sep 07 16:52:08 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:08 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19" returned: 0 in 0.500s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4647f61-ade5-43b6-8167-fc0b1ad54a02]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:08 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:08 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:08 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-9cffb886-4ac0-466c-ba5f-c585e08e69ea tempest-TestShelveInstance-713532939 None] Terminate volume connection completed successfully. Sep 07 16:52:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-9cffb886-4ac0-466c-ba5f-c585e08e69ea tempest-TestShelveInstance-713532939 None] Deleting attachment 4da8d5c4-2f14-4cd1-9dbd-6f19395af3f2. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:52:09 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.524s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:09 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 Sep 07 16:52:09 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[452f7860-51f1-456a-a0f9-725df3bf0c1d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Acquiring lock "cinder-fb3d724b-3cd4-431c-8396-48a0889afade-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Lock "cinder-fb3d724b-3cd4-431c-8396-48a0889afade-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:09 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 Sep 07 16:52:09 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Acquiring lock "cinder-quobyte-fb3d724b-3cd4-431c-8396-48a0889afade" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Lock "cinder-quobyte-fb3d724b-3cd4-431c-8396-48a0889afade" acquired by "delete_volume" :: waited 0.041s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[181ef548-8aba-451f-8711-898de4f4b0b6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:09 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade Sep 07 16:52:09 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:09 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264" returned: 0 in 0.531s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 2G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:09 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19" returned: 0 in 0.729s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:09 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19 Sep 07 16:52:09 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 2G" returned: 0 in 0.166s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.747s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0ec1ef83-ba89-4126-9849-51ff83412cb3 tempest-VolumesExtendTest-1162037430 None] Extend volume completed successfully. Sep 07 16:52:10 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade" returned: 0 in 0.629s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:10 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade Sep 07 16:52:10 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:10 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.c96fe2f4-488a-4a27-9c86-6ca800e7fb19" returned: 0 in 0.360s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c96fe2f4-488a-4a27-9c86-6ca800e7fb19" released by "_delete_snapshot" :: held 2.255s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" released by "delete_snapshot" :: held 2.306s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Created reservations ['2cf4f587-9bc8-467f-a2fa-8f5e41d0e348', 'fdde2f63-5cb3-42ca-b0b9-bdc6fbc80447', '6dd7559f-b1f1-4281-b594-e0fc51c531bc', 'ba7e2458-fcfd-433f-93ad-6cd8ce0c7cd5'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:10 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb3d724b-3cd4-431c-8396-48a0889afade" returned: 0 in 0.333s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Lock "cinder-quobyte-fb3d724b-3cd4-431c-8396-48a0889afade" released by "delete_volume" :: held 1.033s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Delete snapshot completed successfully. Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df5e4292-0ec8-4f0f-b574-7ab6658f2f9a tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-c96fe2f4-488a-4a27-9c86-6ca800e7fb19-delete_snapshot" released by "delete_snapshot" :: held 2.557s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.quota [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Created reservations ['c87834ae-b2db-4b4a-869d-8893b28dd39c', 'a8c72f79-da43-4f23-a1ab-e478e0ec960c', 'a9b5b3fb-2183-466d-ba99-e0fcb7f0d850', '520e3926-54ec-49e8-a01f-6bd030a11590'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:10 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:52:10 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "cinder-17a2789d-0e25-4ba4-8c3e-b0d36e713264-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-17a2789d-0e25-4ba4-8c3e-b0d36e713264-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "cinder-quobyte-17a2789d-0e25-4ba4-8c3e-b0d36e713264" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-17a2789d-0e25-4ba4-8c3e-b0d36e713264" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7865cc5-1a9e-4de8-acf4-2f52b38915e1]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:10 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 Sep 07 16:52:10 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:10 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:10 devstack cinder-volume[87492]: DEBUG cinder.manager [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Deleted volume successfully. Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [req-3b9a3e66-0504-44ba-8e41-5911ca46a935 req-2cfd7533-7084-4732-81f7-16c2f682c63d tempest-TestShelveInstance-713532939 None] Lock "cinder-fb3d724b-3cd4-431c-8396-48a0889afade-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:11 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264" returned: 0 in 0.478s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:11 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264 Sep 07 16:52:11 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:11 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17a2789d-0e25-4ba4-8c3e-b0d36e713264" returned: 0 in 0.343s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-17a2789d-0e25-4ba4-8c3e-b0d36e713264" released by "delete_volume" :: held 0.873s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Created reservations ['75d033ad-057c-48a0-921e-a7e060376a96', 'd30d6592-3f0b-45df-998a-9a604ffe4335', '0419310a-d635-4289-a04d-303f8abc88cd', '90ca389f-1898-4611-8bc2-e4f2e0244046'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Creating offline snapshot 30e2dc85-f16f-4427-bbaf-9a84342c1fd0 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea47854-a9e7-4e43-8d09-a2d5be9fff57]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:11 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:52:11 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:12 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:12 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:12 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.307s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:12 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:12 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Deleted volume successfully. Sep 07 16:52:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66b89e48-d1fb-4244-909f-808b167b4b38 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-17a2789d-0e25-4ba4-8c3e-b0d36e713264-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:12 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.523s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:12 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 1G Sep 07 16:52:12 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:13 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 1G" returned: 0 in 0.635s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:13 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 Sep 07 16:52:13 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:13 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0" returned: 0 in 0.478s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:13 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 is being set with open permissions: ugo+rw Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:13 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 Sep 07 16:52:13 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Flow 'volume_create_manager' (55ca0a31-5fff-4ae9-8234-2a4b67bcb5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9186fc13-f740-4d20-adb2-69dc1f6fbe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9186fc13-f740-4d20-adb2-69dc1f6fbe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-60415239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e64a5f4-4bb9-4816-847c-0c795b4b5aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a121330faef43fca3b1d31c4238a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:14Z,use_quota=True,user_id='5890b14fc4cc468c80a82cf5351fd635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e877e7f-5b37-4e9b-8dc6-921e6a6c8d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e877e7f-5b37-4e9b-8dc6-921e6a6c8d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd41701d-8c98-425c-8eec-a0949b7cdeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd41701d-8c98-425c-8eec-a0949b7cdeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e64a5f4-4bb9-4816-847c-0c795b4b5aa4', 'volume_name': 'volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a078456-635e-4838-8f2b-e1c777cad22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a078456-635e-4838-8f2b-e1c777cad22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7167f0e-e7c3-4aa2-b5e1-c0af7b6f109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Volume 2e64a5f4-4bb9-4816-847c-0c795b4b5aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4', 'volume_size': 1} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:14 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0" returned: 0 in 0.530s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-60415239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e64a5f4-4bb9-4816-847c-0c795b4b5aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a121330faef43fca3b1d31c4238a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:14Z,use_quota=True,user_id='5890b14fc4cc468c80a82cf5351fd635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Creating volume 2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:52:14 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:14 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 1073741824 Sep 07 16:52:14 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:14 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a42acd6b-b4fd-4f26-afc5-51482689aa77 tempest-SnapshotsActionsTest-1399773043 None] Create snapshot completed successfully Sep 07 16:52:14 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 1073741824" returned: 0 in 0.713s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:14 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 Sep 07 16:52:14 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-30e2dc85-f16f-4427-bbaf-9a84342c1fd0-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-30e2dc85-f16f-4427-bbaf-9a84342c1fd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-30e2dc85-f16f-4427-bbaf-9a84342c1fd0" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-30e2dc85-f16f-4427-bbaf-9a84342c1fd0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Deleting offline snapshot 30e2dc85-f16f-4427-bbaf-9a84342c1fd0 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] snapshot_file for this snap is: volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:52:15 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" returned: 0 in 0.396s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[210e0d0c-7e26-43d1-998d-577ab51910be]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7167f0e-e7c3-4aa2-b5e1-c0af7b6f109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe43149-ad2c-4960-ad6c-45a0c5cd8bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:15 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Volume volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 (2e64a5f4-4bb9-4816-847c-0c795b4b5aa4): created successfully Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe43149-ad2c-4960-ad6c-45a0c5cd8bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Flow 'volume_create_manager' (55ca0a31-5fff-4ae9-8234-2a4b67bcb5cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:15 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-046356db-88c3-4fb9-a80e-15824a54451e tempest-VolumesExtendTest-1162037430 None] Created volume successfully. Sep 07 16:52:15 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 Sep 07 16:52:15 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:15 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0" returned: 0 in 0.530s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb89579-c29e-4072-9c90-16d17df751b5]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:16 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:16 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Creating offline snapshot 16db5306-bbd8-4e64-bb34-cd54617b713e of volume 2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3970614d-e3bf-47a9-b403-7da2bbde1893]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:16 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 Sep 07 16:52:16 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:16 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.533s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:16 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 Sep 07 16:52:16 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:16 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" returned: 0 in 0.511s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:16 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e 1G Sep 07 16:52:16 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:16 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0" returned: 0 in 0.569s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:17 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0 Sep 07 16:52:17 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:17 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.30e2dc85-f16f-4427-bbaf-9a84342c1fd0" returned: 0 in 0.551s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:17 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-30e2dc85-f16f-4427-bbaf-9a84342c1fd0" released by "_delete_snapshot" :: held 2.343s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e 1G" returned: 0 in 0.828s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" released by "delete_snapshot" :: held 2.390s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:17 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e Sep 07 16:52:17 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:17 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Created reservations ['0ae0974b-c248-45bb-9065-ef09dd9799f4', 'c00b05ea-c054-48e4-b0d4-7c0fe2a37154', 'eb1bb735-9a3f-4ed6-9130-f2a3f358328a', '97bddf31-4ed9-4867-8b32-89ab221c6930'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:17 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Delete snapshot completed successfully. Sep 07 16:52:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d653bd61-168e-44a6-b2b6-3ff132cb6581 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-30e2dc85-f16f-4427-bbaf-9a84342c1fd0-delete_snapshot" released by "delete_snapshot" :: held 2.798s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:18 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e" returned: 0 in 0.605s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:18 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e is being set with open permissions: ugo+rw Sep 07 16:52:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:18 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e Sep 07 16:52:18 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:18 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e" returned: 0 in 0.401s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:18 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.info Sep 07 16:52:18 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:19 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.info" returned: 0 in 0.576s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:19 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.info is being set with open permissions: ugo+rw Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:19 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.info Sep 07 16:52:19 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:19 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.info" returned: 0 in 0.492s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.596s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.721s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Creating offline snapshot 7b9fed5f-5ff3-40ed-8025-83e46510f112 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:52:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3c8f4fde-8591-4b05-8f8b-1dbf01be3e30 tempest-VolumesExtendTest-1162037430 None] Create snapshot completed successfully Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565693f-281a-430d-899c-adcb059eb6af]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:19 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:19 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:20 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.460s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:20 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 1G Sep 07 16:52:20 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:21 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 1G" returned: 0 in 0.812s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:21 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 Sep 07 16:52:21 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:21 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112" returned: 0 in 0.485s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:21 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 is being set with open permissions: ugo+rw Sep 07 16:52:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:21 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 Sep 07 16:52:21 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:21 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112" returned: 0 in 0.321s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.260s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d160c-f3a8-4c8c-be16-c2f5a257be77]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9d0ecf40-4de3-480d-9620-240ec89eb3fa tempest-SnapshotsActionsTest-1399773043 None] Create snapshot completed successfully Sep 07 16:52:22 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 Sep 07 16:52:22 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-7b9fed5f-5ff3-40ed-8025-83e46510f112-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-7b9fed5f-5ff3-40ed-8025-83e46510f112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-7b9fed5f-5ff3-40ed-8025-83e46510f112" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:22 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" returned: 0 in 0.568s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e 2G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-7b9fed5f-5ff3-40ed-8025-83e46510f112" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Deleting offline snapshot 7b9fed5f-5ff3-40ed-8025-83e46510f112 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] snapshot_file for this snap is: volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6784871-4a17-42db-b5e1-251f29a50b38]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e 2G" returned: 0 in 0.210s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.831s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:22 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 Sep 07 16:52:22 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7cdd3792-e299-4a33-9ea3-d37ae2b99584 tempest-VolumesExtendTest-1162037430 None] Extend volume completed successfully. Sep 07 16:52:23 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112" returned: 0 in 0.712s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90b00fe-fc53-47db-8eba-b0e5c9423adf]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Flow 'volume_create_manager' (074d9b31-33e9-4658-b41e-994007e11aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00a43bb-a17f-4402-8efb-74574df927cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00a43bb-a17f-4402-8efb-74574df927cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1542168262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4e9e8a-6a93-4632-ab81-92ee80540697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e77af944af4959803c32837e31d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:23Z,use_quota=True,user_id='b9efb823d6a54c44825374b763e1eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee346b-e845-4f87-93df-9446e55ee2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ee346b-e845-4f87-93df-9446e55ee2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e5e139-f242-4e9b-bc62-7625b6abd8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e5e139-f242-4e9b-bc62-7625b6abd8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4e9e8a-6a93-4632-ab81-92ee80540697', 'volume_name': 'volume-dd4e9e8a-6a93-4632-ab81-92ee80540697', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6a8a59-fa04-4e82-85f7-036f92baa001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6a8a59-fa04-4e82-85f7-036f92baa001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3e834c-116e-4012-9e71-5e6b404e4515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:23 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Volume dd4e9e8a-6a93-4632-ab81-92ee80540697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4e9e8a-6a93-4632-ab81-92ee80540697', 'volume_size': 1} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1542168262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4e9e8a-6a93-4632-ab81-92ee80540697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e77af944af4959803c32837e31d5d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:23Z,use_quota=True,user_id='b9efb823d6a54c44825374b763e1eab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Creating volume dd4e9e8a-6a93-4632-ab81-92ee80540697 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:52:23 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:23 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 1073741824 Sep 07 16:52:23 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:23 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:23 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:23 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.521s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:24 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 Sep 07 16:52:24 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:24 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "cinder-16db5306-bbd8-4e64-bb34-cd54617b713e-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 1073741824" returned: 0 in 0.619s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-16db5306-bbd8-4e64-bb34-cd54617b713e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "cinder-quobyte-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "cinder-quobyte-16db5306-bbd8-4e64-bb34-cd54617b713e" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-16db5306-bbd8-4e64-bb34-cd54617b713e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Deleting offline snapshot 16db5306-bbd8-4e64-bb34-cd54617b713e of volume 2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:52:24 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 Sep 07 16:52:24 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] snapshot_file for this snap is: volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e2af8c-7518-4e4d-a4ff-d62e9a614c43]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:24 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e Sep 07 16:52:24 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:24 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112" returned: 0 in 0.885s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:25 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112 Sep 07 16:52:25 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:25 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697" returned: 0 in 0.710s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3e834c-116e-4012-9e71-5e6b404e4515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4e9e8a-6a93-4632-ab81-92ee80540697', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:25 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d678c-3dba-4261-9a8b-5da885340feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e" returned: 0 in 0.675s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Volume volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 (dd4e9e8a-6a93-4632-ab81-92ee80540697): created successfully Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d678c-3dba-4261-9a8b-5da885340feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Flow 'volume_create_manager' (074d9b31-33e9-4658-b41e-994007e11aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7427fea-0448-4afc-b92d-1a07e7c963db]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a2207138-d25c-4879-8da0-f1b3bfe98d41 tempest-TestMinimumBasicScenario-728604860 None] Created volume successfully. Sep 07 16:52:25 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.7b9fed5f-5ff3-40ed-8025-83e46510f112" returned: 0 in 0.474s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-7b9fed5f-5ff3-40ed-8025-83e46510f112" released by "_delete_snapshot" :: held 2.747s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" released by "delete_snapshot" :: held 2.836s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:25 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 Sep 07 16:52:25 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Created reservations ['104ad878-6dce-4e34-80c9-2a65f496a13f', 'f1b46bae-9a6c-4fd6-9367-a59be95b332a', 'eb933f1d-3d60-420b-aacb-cc9777a34bd2', 'ee241b95-3999-4e04-a1c0-1d87de2d448f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Delete snapshot completed successfully. Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52c1c178-3463-4c26-80d9-25a4a2dd4d47 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-7b9fed5f-5ff3-40ed-8025-83e46510f112-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:25 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" returned: 0 in 0.536s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:25 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e Sep 07 16:52:25 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:26 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e" returned: 0 in 0.840s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Creating offline snapshot 8630b17d-7cf7-4a0f-bf01-1017be59966d of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:52:26 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e Sep 07 16:52:26 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb99198-1e75-471b-9677-16ebf65a5f14]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:26 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4.16db5306-bbd8-4e64-bb34-cd54617b713e" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-16db5306-bbd8-4e64-bb34-cd54617b713e" released by "_delete_snapshot" :: held 2.637s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" released by "delete_snapshot" :: held 2.704s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:27 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:27 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Created reservations ['89091a29-86a9-4f07-9625-7bfad9326222', '9fc612c9-02ae-491a-86c1-95fec5907bca', '2a61740f-bc88-401f-9dde-447268a8e6e4', 'a2f335f7-5d00-4250-80bf-c34fa80d283d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Delete snapshot completed successfully. Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-320721fa-a6e9-4720-9bd7-1fcea8d23420 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-16db5306-bbd8-4e64-bb34-cd54617b713e-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:27 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.860s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "cinder-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:27 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d 1G Sep 07 16:52:27 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-b0aaead1-2b61-4a4d-9593-b049ab810361 req-fb95f7da-7ab1-4bde-9b77-de8ef2bfe444 tempest-TestMinimumBasicScenario-728604860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "cinder-quobyte-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe47d060-e079-4c84-abcf-e2fb3f2bd968]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:28 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 Sep 07 16:52:28 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:28 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d 1G" returned: 0 in 0.734s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:28 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" returned: 0 in 0.484s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:28 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d Sep 07 16:52:28 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:28 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4 Sep 07 16:52:28 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:28 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" returned: 0 in 0.339s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-quobyte-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4" released by "delete_volume" :: held 0.907s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:28 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d" returned: 0 in 0.409s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:28 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d is being set with open permissions: ugo+rw Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:28 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d Sep 07 16:52:28 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Created reservations ['eb9fbf69-88ae-4c36-80ff-d18c581bf488', '184934a9-2809-4790-89b6-e383ae5a67a4', 'ffe1a3f0-4558-4522-bbbf-bb3b322a3c63', 'e44fdba9-34be-4725-a9ec-3c19f77ba01e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:29 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:52:29 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:29 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d" returned: 0 in 0.368s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-b0aaead1-2b61-4a4d-9593-b049ab810361 req-fb95f7da-7ab1-4bde-9b77-de8ef2bfe444 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.423s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-b0aaead1-2b61-4a4d-9593-b049ab810361 req-fb95f7da-7ab1-4bde-9b77-de8ef2bfe444 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1695ac26-ab3d-4be7-b95a-564080250252 tempest-SnapshotsActionsTest-1399773043 None] Create snapshot completed successfully Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-b0aaead1-2b61-4a4d-9593-b049ab810361 req-fb95f7da-7ab1-4bde-9b77-de8ef2bfe444 tempest-TestMinimumBasicScenario-728604860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-dd4e9e8a-6a93-4632-ab81-92ee80540697', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '829b48c3-9e81-4a11-82f1-1d0faa0d8b47', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:52:29 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.415s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-b0aaead1-2b61-4a4d-9593-b049ab810361 req-fb95f7da-7ab1-4bde-9b77-de8ef2bfe444 tempest-TestMinimumBasicScenario-728604860 None] attachment_update completed successfully. Sep 07 16:52:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Deleted volume successfully. Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-edad62fb-8fc6-4fdd-aaa2-35015debc9c0 tempest-VolumesExtendTest-1162037430 None] Lock "cinder-2e64a5f4-4bb9-4816-847c-0c795b4b5aa4-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-8630b17d-7cf7-4a0f-bf01-1017be59966d-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-8630b17d-7cf7-4a0f-bf01-1017be59966d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Acquiring lock "cinder-quobyte-8630b17d-7cf7-4a0f-bf01-1017be59966d" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-8630b17d-7cf7-4a0f-bf01-1017be59966d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Deleting offline snapshot 8630b17d-7cf7-4a0f-bf01-1017be59966d of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] snapshot_file for this snap is: volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c1cbbb-3f0d-450c-b063-eaf39bddee5b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:30 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d Sep 07 16:52:30 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:30 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d" returned: 0 in 0.621s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:30 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[30505df9-dcd7-45e8-9ff5-f46b0c5c7135]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:30 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:30 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:31 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.565s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:31 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d Sep 07 16:52:31 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:31 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d" returned: 0 in 0.634s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:31 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d Sep 07 16:52:31 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:32 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.8630b17d-7cf7-4a0f-bf01-1017be59966d" returned: 0 in 0.461s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-8630b17d-7cf7-4a0f-bf01-1017be59966d" released by "_delete_snapshot" :: held 2.450s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" released by "delete_snapshot" :: held 2.489s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:32 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Created reservations ['ec7babfb-18a3-4bc3-bf2a-77f5768119de', '51283cdc-220e-4886-bcc6-67cb1e009111', '6c665cbd-f294-4262-be39-e481b3550c62', 'c9934964-059b-48ad-b441-9cb04cd58b02'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Delete snapshot completed successfully. Sep 07 16:52:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-dd8c8dad-1ef1-4012-b610-a97e446e11c3 tempest-SnapshotsActionsTest-1837062505 None] Lock "cinder-8630b17d-7cf7-4a0f-bf01-1017be59966d-delete_snapshot" released by "delete_snapshot" :: held 2.734s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:33 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:52:33 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:33 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.483s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:52:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "cinder-1be3c24e-9f77-4c0b-8722-77a7a83b4706-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-1be3c24e-9f77-4c0b-8722-77a7a83b4706-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "cinder-quobyte-1be3c24e-9f77-4c0b-8722-77a7a83b4706" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-quobyte-1be3c24e-9f77-4c0b-8722-77a7a83b4706" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Deleting offline snapshot 1be3c24e-9f77-4c0b-8722-77a7a83b4706 of volume c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] snapshot_file for this snap is: volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d87301-5774-49fe-9a8d-8f99df48276c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:34 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:34 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:34 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fef1d2f-23c3-4d30-b593-aaaf13edc3f1]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:34 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc Sep 07 16:52:34 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:35 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" returned: 0 in 0.477s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:35 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:35 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:35 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.542s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:35 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706 Sep 07 16:52:35 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:36 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc.1be3c24e-9f77-4c0b-8722-77a7a83b4706" returned: 0 in 0.317s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-quobyte-1be3c24e-9f77-4c0b-8722-77a7a83b4706" released by "_delete_snapshot" :: held 1.932s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" released by "delete_snapshot" :: held 1.964s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Created reservations ['4d04abad-34d1-48f4-8150-23fb6b302879', 'c7da4a2b-7ab7-4f07-984a-a03eae6d9187', '774e724d-3b80-41cd-b53a-3d5406de0b39', '22cdbc9b-47d6-4bf3-a5e1-c34d928566c6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Delete snapshot completed successfully. Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e97dd14-5a33-404e-922e-1905f7f83ccb tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-1be3c24e-9f77-4c0b-8722-77a7a83b4706-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (23632424-b4ef-408a-925b-e6738c9c7e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b56978-3ba0-4cd0-9e1a-28227f6eef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b56978-3ba0-4cd0-9e1a-28227f6eef3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1527281093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f8475b-1091-43e8-862a-91ce964999c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:37Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f742b06-0f00-49f6-b15c-134385576399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f742b06-0f00-49f6-b15c-134385576399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c483f9-9a72-4e06-887a-3bbf47036613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c483f9-9a72-4e06-887a-3bbf47036613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f8475b-1091-43e8-862a-91ce964999c1', 'volume_name': 'volume-90f8475b-1091-43e8-862a-91ce964999c1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35519265-b10e-4de3-b566-5b136a10f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35519265-b10e-4de3-b566-5b136a10f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf898d36-d0da-4dfa-8908-1c424dac3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:36 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Volume 90f8475b-1091-43e8-862a-91ce964999c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f8475b-1091-43e8-862a-91ce964999c1', 'volume_size': 1} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1527281093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f8475b-1091-43e8-862a-91ce964999c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:37Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Creating volume 90f8475b-1091-43e8-862a-91ce964999c1 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:52:36 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:52:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:36 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 1073741824 Sep 07 16:52:36 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:37 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 1073741824" returned: 0 in 0.581s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "cinder-c6e0bb83-d03d-4cca-b18a-bc026be70ddc-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:37 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 Sep 07 16:52:37 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-c6e0bb83-d03d-4cca-b18a-bc026be70ddc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be57c9b-4909-41fa-80aa-6b6f5d9c1bec]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:37 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1" returned: 0 in 0.316s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf898d36-d0da-4dfa-8908-1c424dac3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f8475b-1091-43e8-862a-91ce964999c1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888ee7b6-8c1e-4198-870d-1136df7ba12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:37 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc Sep 07 16:52:37 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:37 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Volume volume-90f8475b-1091-43e8-862a-91ce964999c1 (90f8475b-1091-43e8-862a-91ce964999c1): created successfully Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888ee7b6-8c1e-4198-870d-1136df7ba12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (23632424-b4ef-408a-925b-e6738c9c7e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-036594db-522f-40be-88f7-e86edbc2f314 tempest-VolumesGetTest-974690442 None] Created volume successfully. Sep 07 16:52:38 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" returned: 0 in 0.456s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:38 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc Sep 07 16:52:38 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:38 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" returned: 0 in 0.335s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-quobyte-c6e0bb83-d03d-4cca-b18a-bc026be70ddc" released by "delete_volume" :: held 0.881s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Created reservations ['5bee2557-0463-442f-92f1-c0e1b494f404', 'f2dcd6e4-1d5e-4ef7-8317-090e18b556c8', '9a2da428-81fb-4adc-82b4-15f42b768846', 'a9c1220c-b549-4563-8959-76fc2619517e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:38 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:52:38 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:38 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.333s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:38 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Deleted volume successfully. Sep 07 16:52:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-61a842e8-e623-40d9-94c2-4a2413bfd839 tempest-SnapshotsActionsTest-1399773043 None] Lock "cinder-c6e0bb83-d03d-4cca-b18a-bc026be70ddc-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (44fdcf91-0d96-46ca-9ffe-805ba9ab3e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb664360-888b-420d-af2c-6034082dfebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb664360-888b-420d-af2c-6034082dfebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-383837902',display_name='tempest-VolumesGetTest-Volume-1583074961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a035f26-ea11-42c0-8f58-0796c3a82bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:40Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2b2fdd-97bd-45bf-a832-1ab27dc79ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2b2fdd-97bd-45bf-a832-1ab27dc79ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e64f9cc-d7b2-4e29-994d-5f918f722961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e64f9cc-d7b2-4e29-994d-5f918f722961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a035f26-ea11-42c0-8f58-0796c3a82bf5', 'volume_name': 'volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b7231c-9b00-47db-a0f2-2c958f9e745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b7231c-9b00-47db-a0f2-2c958f9e745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e435f0e-e5eb-479b-bca0-63603aca2740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:39 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Volume 9a035f26-ea11-42c0-8f58-0796c3a82bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5', 'volume_size': 1} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-383837902',display_name='tempest-VolumesGetTest-Volume-1583074961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a035f26-ea11-42c0-8f58-0796c3a82bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:40Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Creating volume 9a035f26-ea11-42c0-8f58-0796c3a82bf5 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:52:39 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:52:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:39 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 1073741824 Sep 07 16:52:39 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:40 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 1073741824" returned: 0 in 0.706s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:40 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 Sep 07 16:52:40 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:41 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5" returned: 0 in 0.350s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:52:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e435f0e-e5eb-479b-bca0-63603aca2740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4295b000-5b32-4817-a099-ee65f4801c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:41 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Volume volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 (9a035f26-ea11-42c0-8f58-0796c3a82bf5): created successfully Sep 07 16:52:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4295b000-5b32-4817-a099-ee65f4801c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (44fdcf91-0d96-46ca-9ffe-805ba9ab3e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8f9d2d9b-99a4-4d26-8cc0-3bce984f1484 tempest-VolumesGetTest-974690442 None] Created volume successfully. Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-9a035f26-ea11-42c0-8f58-0796c3a82bf5-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Lock "cinder-9a035f26-ea11-42c0-8f58-0796c3a82bf5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-9a035f26-ea11-42c0-8f58-0796c3a82bf5" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-9a035f26-ea11-42c0-8f58-0796c3a82bf5" acquired by "delete_volume" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[21469346-7809-4500-9356-ead496b3a60b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:42 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 Sep 07 16:52:42 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:42 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5" returned: 0 in 0.529s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:42 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5 Sep 07 16:52:42 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:43 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9a035f26-ea11-42c0-8f58-0796c3a82bf5" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-9a035f26-ea11-42c0-8f58-0796c3a82bf5" released by "delete_volume" :: held 0.904s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Created reservations ['b5924794-4d70-4783-b908-022b7142b92c', 'd787c594-f3f1-47b9-99f3-a2f10969a5f4', 'ea79c585-7351-4795-9abe-726e78c550ab', '547dd4bd-5952-4f7c-8f21-80a764f5ad72'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:43 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:52:43 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:43 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.416s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Deleted volume successfully. Sep 07 16:52:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-30946b52-39b9-42f7-8607-901a8a32b06e tempest-VolumesGetTest-974690442 None] Lock "cinder-9a035f26-ea11-42c0-8f58-0796c3a82bf5-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-90f8475b-1091-43e8-862a-91ce964999c1-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Lock "cinder-90f8475b-1091-43e8-862a-91ce964999c1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-90f8475b-1091-43e8-862a-91ce964999c1" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-90f8475b-1091-43e8-862a-91ce964999c1" acquired by "delete_volume" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ca60c9-f6b7-4b74-99d6-53d521938230]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:44 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 Sep 07 16:52:44 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:45 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1" returned: 0 in 0.691s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:45 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1 Sep 07 16:52:45 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:45 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-90f8475b-1091-43e8-862a-91ce964999c1" returned: 0 in 0.328s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-90f8475b-1091-43e8-862a-91ce964999c1" released by "delete_volume" :: held 1.085s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=127,cinder:SELECT=117,cinder:INSERT=36,cinder:DELETE=8 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Created reservations ['5175a3c4-bee2-4a63-a951-30e98aad7104', '30132bad-52dd-4046-bd79-ce79b4f2e1c7', 'db19610b-6693-435f-98e7-5505d643a2a9', 'b4b6a86a-3f8f-4908-a167-c8d338e3100e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:45 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:52:45 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:46 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.388s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:46 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Deleted volume successfully. Sep 07 16:52:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a696ec6-d13b-49e7-9ad2-d455d45c23e5 tempest-VolumesGetTest-974690442 None] Lock "cinder-90f8475b-1091-43e8-862a-91ce964999c1-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (a4b14279-cfd9-4e54-9bba-8ee64bdbd66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9302ea-ef10-4676-bd74-2ef3e1e15010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9302ea-ef10-4676-bd74-2ef3e1e15010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-746150459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d064cfa9-c16f-4c3a-a541-9e5064bc3148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:47Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3000f734-df1f-4854-967c-5052fd72f2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3000f734-df1f-4854-967c-5052fd72f2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ecd4e8-e26a-4243-ac5c-b7c8f58a240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ecd4e8-e26a-4243-ac5c-b7c8f58a240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd064cfa9-c16f-4c3a-a541-9e5064bc3148', 'volume_name': 'volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6776fa6f-4c6e-4763-927b-11d607ffaaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6776fa6f-4c6e-4763-927b-11d607ffaaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310bd3f7-685d-4537-b2dc-16580b567707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:47 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Volume d064cfa9-c16f-4c3a-a541-9e5064bc3148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148', 'volume_size': 1} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-746150459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d064cfa9-c16f-4c3a-a541-9e5064bc3148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:47Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Creating volume d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:52:47 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:52:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:47 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 1073741824 Sep 07 16:52:47 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:48 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 1073741824" returned: 0 in 0.554s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:48 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 Sep 07 16:52:48 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:48 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148" returned: 0 in 0.392s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310bd3f7-685d-4537-b2dc-16580b567707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf45e9fe-af64-4224-aedb-30e6ff36caab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:48 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Volume volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 (d064cfa9-c16f-4c3a-a541-9e5064bc3148): created successfully Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf45e9fe-af64-4224-aedb-30e6ff36caab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (a4b14279-cfd9-4e54-9bba-8ee64bdbd66d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7251ad29-0928-4c87-b6ca-054e4e917c70 tempest-VolumesGetTest-974690442 None] Created volume successfully. Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (add7e19c-db7d-4ad4-a4f5-e0bee8413eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165b937f-e499-46ee-8654-aab6a28b432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165b937f-e499-46ee-8654-aab6a28b432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-114380741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d064cfa9-c16f-4c3a-a541-9e5064bc3148,status='creating',terminated_at=None,updated_at=2026-09-07T14:52:50Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6704de-f0af-4d47-8578-f7a3855bdbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6704de-f0af-4d47-8578-f7a3855bdbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e914e07-1ed7-45b6-bf24-fbc01651835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=106,cinder:UPDATE=110,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e914e07-1ed7-45b6-bf24-fbc01651835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a', 'volume_name': 'volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a', 'volume_size': 1, 'source_volid': 'd064cfa9-c16f-4c3a-a541-9e5064bc3148', 'source_volstatus': 'available'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876b3328-ebf3-469d-8614-471c97302ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876b3328-ebf3-469d-8614-471c97302ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f06c8c-c4f6-458d-af1c-1e3318779038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:52:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Volume afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a', 'volume_size': 1, 'source_volid': 'd064cfa9-c16f-4c3a-a541-9e5064bc3148', 'source_volstatus': 'available'} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:50 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Cloning volume d064cfa9-c16f-4c3a-a541-9e5064bc3148 to volume afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Creating offline snapshot ad09e50b-1cbb-48e3-8f08-6709f95342d2 of volume d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2f15d-5efe-4d3c-a5bb-3ba16958d555]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:50 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 Sep 07 16:52:50 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:51 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148" returned: 0 in 0.472s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:51 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 1G Sep 07 16:52:51 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:51 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 1G" returned: 0 in 0.607s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:51 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 Sep 07 16:52:51 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:52 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:52 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 is being set with open permissions: ugo+rw Sep 07 16:52:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:52 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 Sep 07 16:52:52 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:52 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2" returned: 0 in 0.352s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:52 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.info Sep 07 16:52:52 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:53 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.info" returned: 0 in 0.541s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:53 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.info is being set with open permissions: ugo+rw Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:53 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.info Sep 07 16:52:53 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:53 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.info" returned: 0 in 0.425s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] snapshot: ad09e50b-1cbb-48e3-8f08-6709f95342d2, volume: afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[197eecf2-adcb-42cc-b8a7-bb4d20926cb3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:53 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 Sep 07 16:52:53 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:54 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2" returned: 0 in 0.563s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f58ee-6202-4d1e-a14f-9e7656558e69]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:54 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 Sep 07 16:52:54 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:54 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148" returned: 0 in 0.506s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:52:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:54 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a Sep 07 16:52:54 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:01 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" returned: 0 in 7.112s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:01 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:53:01 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Converted 1024.00 MB image at 143.94 MB/s Sep 07 16:53:01 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a is being set with open permissions: ugo+rw Sep 07 16:53:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:01 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a Sep 07 16:53:01 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:02 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" returned: 0 in 0.478s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" released by "_copy_volume_from_snapshot" :: held 8.831s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-ad09e50b-1cbb-48e3-8f08-6709f95342d2" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-ad09e50b-1cbb-48e3-8f08-6709f95342d2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Deleting offline snapshot ad09e50b-1cbb-48e3-8f08-6709f95342d2 of volume d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] snapshot_file for this snap is: volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea421bb4-1962-4388-9f15-bfe4006f4b3b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:02 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:53:02 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 Sep 07 16:53:02 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:03 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2" returned: 0 in 0.557s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:53:03 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9181d1-aafe-4ea6-8c8a-fb41f4eba82f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:03 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 Sep 07 16:53:03 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:03 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148" returned: 0 in 0.882s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:04 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 Sep 07 16:53:04 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:04 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2" returned: 0 in 0.617s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:04 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2 Sep 07 16:53:04 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:04 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148.ad09e50b-1cbb-48e3-8f08-6709f95342d2" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-ad09e50b-1cbb-48e3-8f08-6709f95342d2" released by "_delete_snapshot" :: held 2.508s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.465s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f06c8c-c4f6-458d-af1c-1e3318779038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a', 'volume_size': 1, 'source_volid': 'd064cfa9-c16f-4c3a-a541-9e5064bc3148', 'source_volstatus': 'available'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c16d9f-a411-4f5e-958d-6c14d798ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:05 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Volume volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a (afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a): created successfully Sep 07 16:53:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c16d9f-a411-4f5e-958d-6c14d798ed62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (add7e19c-db7d-4ad4-a4f5-e0bee8413eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a4b4cd72-aedd-4d13-bf69-0c7e3826b63d tempest-VolumesGetTest-974690442 None] Created volume successfully. Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (2a278a50-0882-4441-9acf-c403c40a67d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2469769-a5a6-4387-95ee-ebc70e4b1475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2469769-a5a6-4387-95ee-ebc70e4b1475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-420147364',display_name='tempest-VolumesGetTest-Volume-1042082162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:07Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa974de-707a-4888-861f-2db9f7e6996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa974de-707a-4888-861f-2db9f7e6996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091cd2a-da47-4341-bd83-a20ad6a87e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6091cd2a-da47-4341-bd83-a20ad6a87e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2', 'volume_name': 'volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314be4e4-74fe-4683-9f64-597bf8d6fb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314be4e4-74fe-4683-9f64-597bf8d6fb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad385b11-8400-4413-a6c6-4409d6a60ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:06 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Volume 69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2', 'volume_size': 1} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-420147364',display_name='tempest-VolumesGetTest-Volume-1042082162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:07Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Creating volume 69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:53:06 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:53:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:06 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 1073741824 Sep 07 16:53:06 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:07 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 1073741824" returned: 0 in 0.689s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:07 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 Sep 07 16:53:07 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:08 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2" returned: 0 in 0.519s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:53:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad385b11-8400-4413-a6c6-4409d6a60ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddda1596-b3ae-4615-b32e-e33403316f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:08 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Volume volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 (69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2): created successfully Sep 07 16:53:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddda1596-b3ae-4615-b32e-e33403316f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (2a278a50-0882-4441-9acf-c403c40a67d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:08 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b0cddf8c-6877-4077-b2cb-315449fc1f9d tempest-VolumesGetTest-974690442 None] Created volume successfully. Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Lock "cinder-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1453dd04-881b-4e4f-85de-106a0cc28ed7]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:09 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 Sep 07 16:53:09 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Flow 'volume_create_manager' (4130521a-2e9b-4b8b-bd66-33b5e99f0750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd80736-7ffb-418a-9419-4bf2493d1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd80736-7ffb-418a-9419-4bf2493d1137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1947248974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef535d9-395e-484e-89b7-9b6f93037686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b341eefb2b43491bb02b0ba4ea421e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:09Z,use_quota=True,user_id='cc6c4cdd44384b4291ea5d1addd73581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723196b7-d1f4-4363-837f-b4103e6d79f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723196b7-d1f4-4363-837f-b4103e6d79f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959fa01d-5e09-45f0-a127-7e2806a9500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959fa01d-5e09-45f0-a127-7e2806a9500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef535d9-395e-484e-89b7-9b6f93037686', 'volume_name': 'volume-bef535d9-395e-484e-89b7-9b6f93037686', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5592606c-55f9-4207-9442-6b048e771116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5592606c-55f9-4207-9442-6b048e771116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d903b0-f5b5-41f0-b443-15702e0da9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:09 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Volume bef535d9-395e-484e-89b7-9b6f93037686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef535d9-395e-484e-89b7-9b6f93037686', 'volume_size': 1} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1947248974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef535d9-395e-484e-89b7-9b6f93037686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b341eefb2b43491bb02b0ba4ea421e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:09Z,use_quota=True,user_id='cc6c4cdd44384b4291ea5d1addd73581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Creating volume bef535d9-395e-484e-89b7-9b6f93037686 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:53:09 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:09 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 1073741824 Sep 07 16:53:09 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:09 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2" returned: 0 in 0.396s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:09 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2 Sep 07 16:53:09 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:10 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2" returned: 0 in 0.286s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2" released by "delete_volume" :: held 0.755s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:10 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 1073741824" returned: 0 in 0.476s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Created reservations ['eb743c36-e383-4bfb-993b-24da7855f631', '62b14d6a-245b-4c4c-bbea-530ae41f166d', '94eb6be4-882a-433a-9398-a5254cd50dc2', 'e4e7d49e-0b23-4d6e-b32e-1d9f7942d8f8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:10 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 Sep 07 16:53:10 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:10 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:10 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:10 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686" returned: 0 in 0.291s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d903b0-f5b5-41f0-b443-15702e0da9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef535d9-395e-484e-89b7-9b6f93037686', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c651919c-e179-49e4-8ae0-e86d6c2af06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:10 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Volume volume-bef535d9-395e-484e-89b7-9b6f93037686 (bef535d9-395e-484e-89b7-9b6f93037686): created successfully Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c651919c-e179-49e4-8ae0-e86d6c2af06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Flow 'volume_create_manager' (4130521a-2e9b-4b8b-bd66-33b5e99f0750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:10 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d2a1fd0d-a21d-4764-9fef-97df17719c5e tempest-TestImageHashVerification-1495461324 None] Created volume successfully. Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Lock "cinder-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.348s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Deleted volume successfully. Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ccab8de-b43e-48b1-a3c8-0692943474b6 tempest-VolumesGetTest-974690442 None] Lock "cinder-69f6eb51-2abb-4da9-8c94-1b0e6bdb1cc2-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b89403-f6d7-4a97-bc5f-9716bf1ed241]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:10 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a Sep 07 16:53:10 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:11 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" returned: 0 in 0.380s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:11 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a Sep 07 16:53:11 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:11 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a" released by "delete_volume" :: held 0.664s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Created reservations ['39065492-6191-4330-b725-090ad20ceb09', '8151bff1-e204-41df-ab46-f56434db9630', '798c16de-dda4-487c-84ce-8c228588c37c', 'f2cb744d-4c3f-498b-a088-946b9d116f8e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:11 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:11 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:11 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.262s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Deleted volume successfully. Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-52cab633-fb91-4fa1-b203-8939d4c9b6a2 tempest-VolumesGetTest-974690442 None] Lock "cinder-afd53132-f9ea-4e9a-bfcb-c3dfb7f2349a-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-d064cfa9-c16f-4c3a-a541-9e5064bc3148-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Lock "cinder-d064cfa9-c16f-4c3a-a541-9e5064bc3148-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-d064cfa9-c16f-4c3a-a541-9e5064bc3148" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-d064cfa9-c16f-4c3a-a541-9e5064bc3148" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01d4a8d-e1c3-4a53-81d1-3845c060d380]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:12 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 Sep 07 16:53:12 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:12 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148" returned: 0 in 0.392s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:12 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148 Sep 07 16:53:12 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:12 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d064cfa9-c16f-4c3a-a541-9e5064bc3148" returned: 0 in 0.282s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ec7349-181a-4fae-8de4-0872da3b34e4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-d064cfa9-c16f-4c3a-a541-9e5064bc3148" released by "delete_volume" :: held 0.759s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Created reservations ['0562641b-62a3-4ec2-8dec-89edd968178a', '11f650a1-88d8-4a4b-afb7-6043c9598bc0', '89b2ca8b-af91-4394-85a8-fe0a17e34590', '632273ee-20d1-43d2-8c4c-96aeea099088'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:12 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 Sep 07 16:53:12 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:12 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:12 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Flow 'volume_create_manager' (eb6055b6-6626-4dc2-b218-32a1716513d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4bc391-2a95-480d-89b7-de348e0d6824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4bc391-2a95-480d-89b7-de348e0d6824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2116377398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c3e0d8-ff9c-446a-8bc8-ed6e59758de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dfa34b64f7472ea78aae694ded16b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:13Z,use_quota=True,user_id='25ef8c813b2f4cd2bf4fb97c7cfc283d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1905d064-e86a-4620-ab85-1a48de3be013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1905d064-e86a-4620-ab85-1a48de3be013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457f15b5-8804-42e1-851f-954a1ee9ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457f15b5-8804-42e1-851f-954a1ee9ca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c3e0d8-ff9c-446a-8bc8-ed6e59758de7', 'volume_name': 'volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87408940-97b9-40ba-bdc2-2e44ad54b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87408940-97b9-40ba-bdc2-2e44ad54b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62042b9c-0b15-43a8-8777-ee9ecf60866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Volume 71c3e0d8-ff9c-446a-8bc8-ed6e59758de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7', 'volume_size': 1} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:13 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686" returned: 0 in 0.446s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b986f9a-8f83-4423-aeb7-8d849753f462]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:13 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.265s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Deleted volume successfully. Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051da73e-07e0-4693-bb89-66f87bbb7d00 tempest-VolumesGetTest-974690442 None] Lock "cinder-d064cfa9-c16f-4c3a-a541-9e5064bc3148-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:13 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 Sep 07 16:53:13 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:13 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686" returned: 0 in 0.376s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 /opt/stack/data/cinder/conversion/bef535d9-395e-484e-89b7-9b6f93037686.temp_image.9a4574b2-3855-4163-845c-3ca6fb9762642xxp2ofo.img {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:13 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 /opt/stack/data/cinder/conversion/bef535d9-395e-484e-89b7-9b6f93037686.temp_image.9a4574b2-3855-4163-845c-3ca6fb9762642xxp2ofo.img Sep 07 16:53:13 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (26f54525-98c5-48a6-8b56-1f0ff8a63739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af65e7a4-3202-4fbc-83d9-aeb1b616a6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af65e7a4-3202-4fbc-83d9-aeb1b616a6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2024032868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e833d2-5ddf-4975-9351-92e37c2c4c7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:14Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c170518f-e160-4dff-8aaa-82c4e04d1bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c170518f-e160-4dff-8aaa-82c4e04d1bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977fa8cf-8fe7-4ada-bba9-403fefdf3d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:14 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:53:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977fa8cf-8fe7-4ada-bba9-403fefdf3d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63e833d2-5ddf-4975-9351-92e37c2c4c7b', 'volume_name': 'volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aba4389-0a4c-4e68-a824-2a4f035f7099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aba4389-0a4c-4e68-a824-2a4f035f7099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13254fdb-2c7f-4603-8300-f15f438aa4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:15 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Volume 63e833d2-5ddf-4975-9351-92e37c2c4c7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 16:53:15 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Trying to clone 63e833d2-5ddf-4975-9351-92e37c2c4c7b from image cd35955c-2cfe-436b-a709-f0de1afb8856 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:53:16 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:53:16 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Image download 20.69 MB at 20.69 MB/s Sep 07 16:53:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea58a73-0e32-468f-8097-b7d2c1b83e27]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:16 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD Sep 07 16:53:16 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:17 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD" returned: 0 in 1.021s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:17 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 is fetched for user 6434c543e8834856b4acb1308dfd67e7. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:53:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c6b249-175f-421a-aedd-69567e66ae33]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:18 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD Sep 07 16:53:18 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:18 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:19 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 /opt/stack/data/cinder/conversion/bef535d9-395e-484e-89b7-9b6f93037686.temp_image.9a4574b2-3855-4163-845c-3ca6fb9762642xxp2ofo.img" returned: 0 in 6.089s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbbb0ab-caaa-42a5-8421-c819b99cecf9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:19 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 Sep 07 16:53:19 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:20 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686" returned: 0 in 0.541s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:20 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/conversion/bef535d9-395e-484e-89b7-9b6f93037686.temp_image.9a4574b2-3855-4163-845c-3ca6fb9762642xxp2ofo.img {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:53:20 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Converted 1024.00 MB image at 168.15 MB/s Sep 07 16:53:20 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] 9a4574b2-3855-4163-845c-3ca6fb976264 was raw, no need to convert to raw {{(pid=87492) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 16:53:30 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=36,cinder:SELECT=28,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:53:30 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=22,cinder:UPDATE=34,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:33 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:33 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-0d2e0b78-265d-4dc7-acb2-3b1d0e620007 req-f449b397-7998-4a8e-a258-965596eeb1bb tempest-TestMinimumBasicScenario-728604860 None] Terminate volume connection completed successfully. Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-0d2e0b78-265d-4dc7-acb2-3b1d0e620007 req-f449b397-7998-4a8e-a258-965596eeb1bb tempest-TestMinimumBasicScenario-728604860 None] Deleting attachment 829b48c3-9e81-4a11-82f1-1d0faa0d8b47. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:53:33 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:53:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:53:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Acquiring lock "cinder-dd4e9e8a-6a93-4632-ab81-92ee80540697-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Lock "cinder-dd4e9e8a-6a93-4632-ab81-92ee80540697-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Acquiring lock "cinder-quobyte-dd4e9e8a-6a93-4632-ab81-92ee80540697" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Lock "cinder-quobyte-dd4e9e8a-6a93-4632-ab81-92ee80540697" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f6f8d0-0492-4287-ab39-440be820fbe1]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:35 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 Sep 07 16:53:35 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:35 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697" returned: 0 in 0.387s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:35 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697 Sep 07 16:53:35 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:35 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dd4e9e8a-6a93-4632-ab81-92ee80540697" returned: 0 in 0.248s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Lock "cinder-quobyte-dd4e9e8a-6a93-4632-ab81-92ee80540697" released by "delete_volume" :: held 0.681s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Created reservations ['1dd22fda-f365-4dbd-ba2c-bca5d45b9685', '4a89f0fb-2ef2-477a-a7e8-46a5f16f933e', 'c93b2bb4-e892-4fb5-b09e-96520724428a', '96cc1030-4754-49da-ac0f-7847fb4447de'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:35 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:35 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:36 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:36 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Deleted volume successfully. Sep 07 16:53:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-016b0110-2eb0-43be-af48-5f5627ad3726 tempest-TestMinimumBasicScenario-728604860 None] Lock "cinder-dd4e9e8a-6a93-4632-ab81-92ee80540697-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.582s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Uploaded volume to glance image-id: 9a4574b2-3855-4163-845c-3ca6fb976264. {{(pid=87492) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.124s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2116377398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c3e0d8-ff9c-446a-8bc8-ed6e59758de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6dfa34b64f7472ea78aae694ded16b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:13Z,use_quota=True,user_id='25ef8c813b2f4cd2bf4fb97c7cfc283d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Creating volume 71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:53:41 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5ddfe511-e4ad-4d04-9b89-634fe534a428 tempest-TestImageHashVerification-1495461324 None] Copy volume to image completed successfully. Sep 07 16:53:41 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 1073741824 Sep 07 16:53:41 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:41 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 1073741824" returned: 0 in 0.477s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:41 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 Sep 07 16:53:41 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:41 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7" returned: 0 in 0.278s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.452s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2024032868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e833d2-5ddf-4975-9351-92e37c2c4c7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:14Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Creating volume 63e833d2-5ddf-4975-9351-92e37c2c4c7b {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:53:42 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62042b9c-0b15-43a8-8777-ee9ecf60866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:42 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b 1073741824 Sep 07 16:53:42 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6f960c-3e62-43fb-beda-e85e896cfea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:42 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Volume volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 (71c3e0d8-ff9c-446a-8bc8-ed6e59758de7): created successfully Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6f960c-3e62-43fb-beda-e85e896cfea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Flow 'volume_create_manager' (eb6055b6-6626-4dc2-b218-32a1716513d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:42 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9b628621-2c47-465f-85ef-8a73ee913f70 tempest-VolumeQuotasNegativeTestJSON-62721657 None] Created volume successfully. Sep 07 16:53:42 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b 1073741824" returned: 0 in 0.428s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:42 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b Sep 07 16:53:42 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Acquiring lock "cinder-bef535d9-395e-484e-89b7-9b6f93037686-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Lock "cinder-bef535d9-395e-484e-89b7-9b6f93037686-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Acquiring lock "cinder-quobyte-bef535d9-395e-484e-89b7-9b6f93037686" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Lock "cinder-quobyte-bef535d9-395e-484e-89b7-9b6f93037686" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d7148f-835d-4924-bf1f-5b23a5d426e9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:42 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b" returned: 0 in 0.394s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:42 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 Sep 07 16:53:42 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:42 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Attempting download of cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume 63e833d2-5ddf-4975-9351-92e37c2c4c7b. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[565862d5-bd5c-4424-838b-02a23f579bc2]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_de8yurss {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_de8yurss Sep 07 16:53:43 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:43 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686" returned: 0 in 0.565s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686 Sep 07 16:53:43 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:43 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_de8yurss" returned: 0 in 0.413s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_de8yurss {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_de8yurss Sep 07 16:53:43 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:43 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bef535d9-395e-484e-89b7-9b6f93037686" returned: 0 in 0.319s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Lock "cinder-quobyte-bef535d9-395e-484e-89b7-9b6f93037686" released by "delete_volume" :: held 0.950s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Created reservations ['b8097f54-3e18-4059-bac7-b83349b9ed8e', 'bd9beff0-126a-43e9-8788-21aad003928b', '628331b1-3831-4366-91fd-0a83067459f9', 'ef0e0417-b679-4735-824f-60c2aa91a7af'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_de8yurss" returned: 1 in 0.418s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd35955c-2cfe-436b-a709-f0de1afb8856_de8yurss' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5e255d-ce07-4879-901d-c8b329c97fa8]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:43 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:44 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD Sep 07 16:53:44 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Acquiring lock "cinder-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "cinder-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:44 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:44 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Deleted volume successfully. Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee03c8cb-83b7-4f61-adf9-c47827f6e35a tempest-TestImageHashVerification-1495461324 None] Lock "cinder-bef535d9-395e-484e-89b7-9b6f93037686-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Acquiring lock "cinder-quobyte-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "cinder-quobyte-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f426f06-8e29-48d0-86c2-5edec18d0837]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:44 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] cd35955c-2cfe-436b-a709-f0de1afb8856 was qcow2, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:44 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b Sep 07 16:53:44 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:44 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 Sep 07 16:53:44 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:44 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7" returned: 0 in 0.409s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:44 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7 Sep 07 16:53:44 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:44 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7" returned: 0 in 0.301s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "cinder-quobyte-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7" released by "delete_volume" :: held 0.771s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Created reservations ['386fb220-dd2f-45ba-94b9-e208f6056b40', '732ce6ba-1892-487d-aa5f-c130d76a998c', 'ec1ca525-b3fd-47f6-9beb-17f12e741522', 'df4851cc-49d0-4b8b-a229-952db7e0c689'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:45 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:45 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:45 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.369s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Deleted volume successfully. Sep 07 16:53:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-717a6bc6-8ca6-4163-acc4-0e5a4de9ff7f tempest-VolumeQuotasNegativeTestJSON-62721657 None] Lock "cinder-71c3e0d8-ff9c-446a-8bc8-ed6e59758de7-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:46 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b" returned: 0 in 2.228s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:46 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd35955c-2cfe-436b-a709-f0de1afb8856_ixjwjffgdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:53:46 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Converted 112.00 MB image at 50.23 MB/s Sep 07 16:53:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:46 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b 1G Sep 07 16:53:46 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:46 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b 1G" returned: 0 in 0.369s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:46 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Downloaded image cd35955c-2cfe-436b-a709-f0de1afb8856 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}])) to volume 63e833d2-5ddf-4975-9351-92e37c2c4c7b successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:53:46 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Temporary image cd35955c-2cfe-436b-a709-f0de1afb8856 for user 6434c543e8834856b4acb1308dfd67e7 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:53:46 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Marking volume 63e833d2-5ddf-4975-9351-92e37c2c4c7b as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:53:47 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Copying metadata from image cd35955c-2cfe-436b-a709-f0de1afb8856 to 63e833d2-5ddf-4975-9351-92e37c2c4c7b. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:53:47 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Creating volume glance metadata for volume 63e833d2-5ddf-4975-9351-92e37c2c4c7b backed by image cd35955c-2cfe-436b-a709-f0de1afb8856 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:53:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13254fdb-2c7f-4603-8300-f15f438aa4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b', 'volume_size': 1, 'image_id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd35955c-2cfe-436b-a709-f0de1afb8856', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db9950c14efe404eb4f9bf2f17d9b525', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd35955c-2cfe-436b-a709-f0de1afb8856', 'created_at': datetime.datetime(2026, 9, 7, 14, 35, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 35, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd35955c-2cfe-436b-a709-f0de1afb8856/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeae1cac-60ea-48cb-a346-61782209b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:47 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Volume volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b (63e833d2-5ddf-4975-9351-92e37c2c4c7b): created successfully Sep 07 16:53:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeae1cac-60ea-48cb-a346-61782209b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (26f54525-98c5-48a6-8b56-1f0ff8a63739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:47 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f7562546-eb4c-4723-b493-b16150b840a0 tempest-VolumesGetTest-974690442 None] Created volume successfully. Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (6c747047-e41a-4217-8bc9-8ae279d5db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e37c78-9cee-4ff4-9453-e2fd3bb917c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e37c78-9cee-4ff4-9453-e2fd3bb917c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-221088891',display_name='tempest-VolumesGetTest-Volume-832767216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23145a8d-0763-4245-a367-786ff095dbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:49Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b40035-274a-4214-b3a0-d650b270125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b40035-274a-4214-b3a0-d650b270125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb2cdf4-1491-4242-af51-4631163bd93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb2cdf4-1491-4242-af51-4631163bd93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23145a8d-0763-4245-a367-786ff095dbe6', 'volume_name': 'volume-23145a8d-0763-4245-a367-786ff095dbe6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d95c3-299d-4128-988c-b1256e1a2c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d95c3-299d-4128-988c-b1256e1a2c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0f141f-2d43-4482-b1e5-2c81032941f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:49 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Volume 23145a8d-0763-4245-a367-786ff095dbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23145a8d-0763-4245-a367-786ff095dbe6', 'volume_size': 1} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-221088891',display_name='tempest-VolumesGetTest-Volume-832767216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23145a8d-0763-4245-a367-786ff095dbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb1099479c940cf95d67b46df4a4fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:49Z,use_quota=True,user_id='6434c543e8834856b4acb1308dfd67e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Creating volume 23145a8d-0763-4245-a367-786ff095dbe6 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:53:49 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:49 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 1073741824 Sep 07 16:53:49 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:49 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 1073741824" returned: 0 in 0.563s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:49 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 Sep 07 16:53:49 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:50 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6" returned: 0 in 0.309s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:53:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0f141f-2d43-4482-b1e5-2c81032941f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23145a8d-0763-4245-a367-786ff095dbe6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8a43be-517b-4bb5-bb46-2ea783bf5ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Volume volume-23145a8d-0763-4245-a367-786ff095dbe6 (23145a8d-0763-4245-a367-786ff095dbe6): created successfully Sep 07 16:53:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8a43be-517b-4bb5-bb46-2ea783bf5ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Flow 'volume_create_manager' (6c747047-e41a-4217-8bc9-8ae279d5db90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-72fcf01e-d7d3-4553-b6d5-84bb555f8b0e tempest-VolumesGetTest-974690442 None] Created volume successfully. Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-23145a8d-0763-4245-a367-786ff095dbe6-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Lock "cinder-23145a8d-0763-4245-a367-786ff095dbe6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-23145a8d-0763-4245-a367-786ff095dbe6" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-23145a8d-0763-4245-a367-786ff095dbe6" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbabae71-3e97-4583-98a9-d701959cfb1b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:51 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 Sep 07 16:53:51 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:51 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6" returned: 0 in 0.452s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:52 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6 Sep 07 16:53:52 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:52 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-23145a8d-0763-4245-a367-786ff095dbe6" returned: 0 in 0.379s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-23145a8d-0763-4245-a367-786ff095dbe6" released by "delete_volume" :: held 0.909s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Created reservations ['2cf6bc6f-666f-48bc-a9e4-5b6a06ebbaa5', 'd3824432-1006-45cb-9925-db3471f7e50d', '247622c5-dcfe-495b-afc6-467593903b8a', '4d4c856f-ede1-4345-8076-56fcf2321f69'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:52 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:52 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-63e833d2-5ddf-4975-9351-92e37c2c4c7b-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Lock "cinder-63e833d2-5ddf-4975-9351-92e37c2c4c7b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Acquiring lock "cinder-quobyte-63e833d2-5ddf-4975-9351-92e37c2c4c7b" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-63e833d2-5ddf-4975-9351-92e37c2c4c7b" acquired by "delete_volume" :: waited 0.049s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f369acf9-1bed-4c9c-8963-e9941ee3fcca]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:53 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.497s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Deleted volume successfully. Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f11241f-ea0f-4312-b9cf-acddf9a4f173 tempest-VolumesGetTest-974690442 None] Lock "cinder-23145a8d-0763-4245-a367-786ff095dbe6-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:53 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b Sep 07 16:53:53 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:53 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b" returned: 0 in 0.510s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:53 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b Sep 07 16:53:53 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:53 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-63e833d2-5ddf-4975-9351-92e37c2c4c7b" returned: 0 in 0.279s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Lock "cinder-quobyte-63e833d2-5ddf-4975-9351-92e37c2c4c7b" released by "delete_volume" :: held 0.846s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:53 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Created reservations ['3da862ed-fb95-46ee-8fe0-7d33c1689cb4', 'a407f853-8a6a-47f3-8534-c17dbef5126f', 'f9792588-a394-43ca-b682-6e6a8f933f89', '40e0e747-7595-4fc2-903a-417959a4a6e2'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:54 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:53:54 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:54 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.408s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:54 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Deleted volume successfully. Sep 07 16:53:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9bb9b522-dda3-4c26-9ef0-a67b16c6408d tempest-VolumesGetTest-974690442 None] Lock "cinder-63e833d2-5ddf-4975-9351-92e37c2c4c7b-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Flow 'volume_create_manager' (ce878fca-149e-4bda-835d-7cb153a3c055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a414493f-c981-4180-bfe5-0225d358bf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a414493f-c981-4180-bfe5-0225d358bf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-120184341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472337c3-c7f1-44df-b050-b7647c61f986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d2260b3ce74d2a8533e91c73dc2bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:56Z,use_quota=True,user_id='b5639612ab164f2ba988dd359d89a955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68da40fd-092a-4b25-bea0-1aaf69124e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68da40fd-092a-4b25-bea0-1aaf69124e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b288e-91b9-45e9-aa01-48c453bd5cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b288e-91b9-45e9-aa01-48c453bd5cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '472337c3-c7f1-44df-b050-b7647c61f986', 'volume_name': 'volume-472337c3-c7f1-44df-b050-b7647c61f986', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460383e-8524-41d2-90c3-47ebead11844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460383e-8524-41d2-90c3-47ebead11844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61888b49-0ef4-48c1-94ad-eef30fbd3c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Volume 472337c3-c7f1-44df-b050-b7647c61f986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-472337c3-c7f1-44df-b050-b7647c61f986', 'volume_size': 1} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-120184341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472337c3-c7f1-44df-b050-b7647c61f986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d2260b3ce74d2a8533e91c73dc2bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:56Z,use_quota=True,user_id='b5639612ab164f2ba988dd359d89a955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Creating volume 472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:53:56 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:56 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 1073741824 Sep 07 16:53:56 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:56 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 1073741824" returned: 0 in 0.616s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Flow 'volume_create_manager' (85c5fbfe-974a-48b4-bb34-2bac4ef0aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb0010e-953a-4ced-9457-5f81d183e60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb0010e-953a-4ced-9457-5f81d183e60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-357048328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c976ab-6391-4203-9aaa-6f99296e6812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bef98f408204a9f8e28b7ab28583133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:57Z,use_quota=True,user_id='6ee46348fdb647d482d3188e78fc6fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac198029-e996-49d2-906f-54929ef532b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac198029-e996-49d2-906f-54929ef532b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcce109-91f2-4639-9907-1987cb1304c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcce109-91f2-4639-9907-1987cb1304c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c976ab-6391-4203-9aaa-6f99296e6812', 'volume_name': 'volume-52c976ab-6391-4203-9aaa-6f99296e6812', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83073231-ae62-4066-8efc-129d221dc38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83073231-ae62-4066-8efc-129d221dc38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859e7acc-a138-4881-9247-9be8328891e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:56 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Volume 52c976ab-6391-4203-9aaa-6f99296e6812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c976ab-6391-4203-9aaa-6f99296e6812', 'volume_size': 1} Sep 07 16:53:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:57 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 Sep 07 16:53:57 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:57 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986" returned: 0 in 0.324s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-357048328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c976ab-6391-4203-9aaa-6f99296e6812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bef98f408204a9f8e28b7ab28583133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:53:57Z,use_quota=True,user_id='6ee46348fdb647d482d3188e78fc6fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Creating volume 52c976ab-6391-4203-9aaa-6f99296e6812 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:53:57 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61888b49-0ef4-48c1-94ad-eef30fbd3c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-472337c3-c7f1-44df-b050-b7647c61f986', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:57 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 1073741824 Sep 07 16:53:57 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8782bdff-676a-4a85-ae92-6da652b63378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:57 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Volume volume-472337c3-c7f1-44df-b050-b7647c61f986 (472337c3-c7f1-44df-b050-b7647c61f986): created successfully Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8782bdff-676a-4a85-ae92-6da652b63378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Flow 'volume_create_manager' (ce878fca-149e-4bda-835d-7cb153a3c055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-91571688-d72e-4a5c-9fd2-35cafb0103b6 tempest-VolumeDependencyTests-2353420 None] Created volume successfully. Sep 07 16:53:58 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 1073741824" returned: 0 in 0.695s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:58 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 Sep 07 16:53:58 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:58 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812" returned: 0 in 0.431s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Creating offline snapshot 5465cbc5-d82b-4586-836c-83a8cdb9e292 of volume 472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859e7acc-a138-4881-9247-9be8328891e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c976ab-6391-4203-9aaa-6f99296e6812', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f2f241-97eb-4cbf-9329-1df0e7ae7ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaedbf99-a3d2-464e-9219-5f285f7c8dbb]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Volume volume-52c976ab-6391-4203-9aaa-6f99296e6812 (52c976ab-6391-4203-9aaa-6f99296e6812): created successfully Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f2f241-97eb-4cbf-9329-1df0e7ae7ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:53:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Flow 'volume_create_manager' (85c5fbfe-974a-48b4-bb34-2bac4ef0aa14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:53:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0be6f9a2-f509-4584-b9bb-c0cd53b3a058 tempest-VolumesServicesTestJSON-1571843402 None] Created volume successfully. Sep 07 16:53:58 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 Sep 07 16:53:58 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:59 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986" returned: 0 in 0.503s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Acquiring lock "cinder-52c976ab-6391-4203-9aaa-6f99296e6812-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:59 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 1G Sep 07 16:53:59 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Lock "cinder-52c976ab-6391-4203-9aaa-6f99296e6812-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Acquiring lock "cinder-quobyte-52c976ab-6391-4203-9aaa-6f99296e6812" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Lock "cinder-quobyte-52c976ab-6391-4203-9aaa-6f99296e6812" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78bf458-9726-4b54-a0f9-4e7f4fe41556]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:59 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 Sep 07 16:53:59 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:59 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 1G" returned: 0 in 0.674s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-472337c3-c7f1-44df-b050-b7647c61f986 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:59 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-472337c3-c7f1-44df-b050-b7647c61f986 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 Sep 07 16:53:59 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:59 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812" returned: 0 in 0.494s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:59 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812 Sep 07 16:53:59 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:00 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-52c976ab-6391-4203-9aaa-6f99296e6812" returned: 0 in 0.305s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Lock "cinder-quobyte-52c976ab-6391-4203-9aaa-6f99296e6812" released by "delete_volume" :: held 0.889s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:00 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-472337c3-c7f1-44df-b050-b7647c61f986 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292" returned: 0 in 0.376s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:00 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 is being set with open permissions: ugo+rw Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:00 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 Sep 07 16:54:00 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Created reservations ['4e163df9-1b85-46db-adb8-19bf7d639917', 'c5b043e7-3b8e-441f-9d41-168a9032df5f', '2e3603cb-a88b-4dbb-a338-927fc4ab9126', '331f3ac3-19eb-46a1-b3ef-9f7ae3676854'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:00 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:00 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:00 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292" returned: 0 in 0.364s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:00 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.info Sep 07 16:54:00 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:00 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.327s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Deleted volume successfully. Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7cd5f4c6-896d-4d1f-be5d-4f5f1c82df99 tempest-VolumesServicesTestJSON-1571843402 None] Lock "cinder-52c976ab-6391-4203-9aaa-6f99296e6812-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:00 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.info" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:00 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.info is being set with open permissions: ugo+rw Sep 07 16:54:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:00 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.info Sep 07 16:54:00 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:01 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.info" returned: 0 in 0.251s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b2effd71-816a-4ab4-8ced-b4812b6cbe83 tempest-VolumeDependencyTests-2353420 None] Create snapshot completed successfully Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Flow 'volume_create_manager' (5d88613b-3a8a-43e1-9c0b-9730c4860054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd33116-b320-4efc-ab3f-cff2f80a75c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd33116-b320-4efc-ab3f-cff2f80a75c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-262436265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8b56a3-0c81-4833-9ebc-a068a5f583b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d2260b3ce74d2a8533e91c73dc2bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5465cbc5-d82b-4586-836c-83a8cdb9e292,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:03Z,use_quota=True,user_id='b5639612ab164f2ba988dd359d89a955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819643d9-756f-46fa-9e0a-99d5f94af112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819643d9-756f-46fa-9e0a-99d5f94af112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1185f0-199c-424e-a4d8-2d5dfc9d94ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1185f0-199c-424e-a4d8-2d5dfc9d94ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad8b56a3-0c81-4833-9ebc-a068a5f583b5', 'volume_name': 'volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5', 'volume_size': 1, 'snapshot_id': '5465cbc5-d82b-4586-836c-83a8cdb9e292'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc41045-bbea-47ec-a25f-3a8e38bcce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc41045-bbea-47ec-a25f-3a8e38bcce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503fcf95-f4c9-4e25-baa6-98b6a1e7787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:02 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Volume ad8b56a3-0c81-4833-9ebc-a068a5f583b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5', 'volume_size': 1, 'snapshot_id': '5465cbc5-d82b-4586-836c-83a8cdb9e292'} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-quobyte-5465cbc5-d82b-4586-836c-83a8cdb9e292-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-5465cbc5-d82b-4586-836c-83a8cdb9e292-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Creating volume ad8b56a3-0c81-4833-9ebc-a068a5f583b5 from snapshot 5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-quobyte-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] snapshot: 5465cbc5-d82b-4586-836c-83a8cdb9e292, volume: ad8b56a3-0c81-4833-9ebc-a068a5f583b5, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e2e870-8be9-42c0-8749-14794706e77e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (74be8c0d-8289-4249-8018-ec29aee924a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60bce51-9f3b-417e-b3f1-ba86d17c55fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60bce51-9f3b-417e-b3f1-ba86d17c55fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139811363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1d398-a79c-4597-a424-4ae2b8be2349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:03Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fd1562-1828-4a17-b656-e6b698d5514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91fd1562-1828-4a17-b656-e6b698d5514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 Sep 07 16:54:03 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9e62bc-a910-492e-9cdc-ae0fe24988dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9e62bc-a910-492e-9cdc-ae0fe24988dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c1d398-a79c-4597-a424-4ae2b8be2349', 'volume_name': 'volume-56c1d398-a79c-4597-a424-4ae2b8be2349', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbfd8f6-3bf9-4cb0-b588-04f47601deeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbfd8f6-3bf9-4cb0-b588-04f47601deeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e92ee1b-7a04-4925-bdd0-25ea274301a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Volume 56c1d398-a79c-4597-a424-4ae2b8be2349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c1d398-a79c-4597-a424-4ae2b8be2349', 'volume_size': 1} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:03 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292" returned: 0 in 0.633s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-472337c3-c7f1-44df-b050-b7647c61f986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ccdde4-2d90-450f-b1da-caa09fe4ac9d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (832b3cf1-be5a-4a2d-a9d3-c73c13fbdd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85888fd5-581a-4e39-9097-dedcc5da9673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85888fd5-581a-4e39-9097-dedcc5da9673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326402252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:04Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab958ba0-2c68-4c4c-a043-1c92cb1f9fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab958ba0-2c68-4c4c-a043-1c92cb1f9fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f47433-a62b-41d2-a409-a1b4070aaedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f47433-a62b-41d2-a409-a1b4070aaedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9', 'volume_name': 'volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b135ba-0202-48a4-8d08-ab56fb23c145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b135ba-0202-48a4-8d08-ab56fb23c145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d188b5b-c457-4eea-a640-6efb4532d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Volume 6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9', 'volume_size': 1} Sep 07 16:54:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:03 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 Sep 07 16:54:03 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:04 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986" returned: 0 in 0.532s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:04 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 Sep 07 16:54:04 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (b1283f42-ccbb-4614-ad2f-0c13e1739288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6515232-72be-4e0c-aa08-64abafe513fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6515232-72be-4e0c-aa08-64abafe513fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824458802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616d9030-88e3-404b-8936-0e922a4f5c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:04Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a54976-f3f2-4795-8e6e-41eaee043b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a54976-f3f2-4795-8e6e-41eaee043b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798800b9-e2a1-494b-850e-db7017648438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798800b9-e2a1-494b-850e-db7017648438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616d9030-88e3-404b-8936-0e922a4f5c49', 'volume_name': 'volume-616d9030-88e3-404b-8936-0e922a4f5c49', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5001fb45-0bcd-4430-b3c0-ab38442842b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5001fb45-0bcd-4430-b3c0-ab38442842b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fb5edb-0dbc-4eb2-af82-dd9866f8c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Volume 616d9030-88e3-404b-8936-0e922a4f5c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616d9030-88e3-404b-8936-0e922a4f5c49', 'volume_size': 1} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:04 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (1ecb3228-69bd-4c64-9674-ad44ba541cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb55ecde-ca86-4d93-a258-29e8550ea692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb55ecde-ca86-4d93-a258-29e8550ea692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-707030337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edea7af1-4640-4d48-b571-81c6a2bef388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:05Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deb737a-98c7-4f32-9dc9-edd1882a7986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7deb737a-98c7-4f32-9dc9-edd1882a7986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b028049-15bd-4074-b7df-3a7cde021b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b028049-15bd-4074-b7df-3a7cde021b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edea7af1-4640-4d48-b571-81c6a2bef388', 'volume_name': 'volume-edea7af1-4640-4d48-b571-81c6a2bef388', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d66a7-5b3b-40ce-9a22-0cf309fe7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2d66a7-5b3b-40ce-9a22-0cf309fe7086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcbf437-bb5f-4a3a-a9aa-36f4f93d5e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:05 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Volume edea7af1-4640-4d48-b571-81c6a2bef388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edea7af1-4640-4d48-b571-81c6a2bef388', 'volume_size': 1} Sep 07 16:54:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:06 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (c5044627-103b-4dc7-aac4-f6961ca11bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5de970-d18f-41a4-bb47-fc3c9e29b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5de970-d18f-41a4-bb47-fc3c9e29b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1359972963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe96e90-7965-4adb-8edd-bb0c9e7a8611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:07Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525f3434-a462-490d-916e-607770ba5d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (525f3434-a462-490d-916e-607770ba5d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae850c2-2dfd-4118-ae50-702fcfa748f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae850c2-2dfd-4118-ae50-702fcfa748f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe96e90-7965-4adb-8edd-bb0c9e7a8611', 'volume_name': 'volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d4171e-9b5b-4e55-80da-cd95c55239d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d4171e-9b5b-4e55-80da-cd95c55239d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d03c153-0779-48d7-82df-21181b11447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:07 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Volume ebe96e90-7965-4adb-8edd-bb0c9e7a8611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611', 'volume_size': 1} Sep 07 16:54:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:10 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" returned: 0 in 6.539s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:10 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:54:10 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Converted 1024.00 MB image at 156.58 MB/s Sep 07 16:54:10 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 is being set with open permissions: ugo+rw Sep 07 16:54:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:10 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 Sep 07 16:54:10 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:11 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" returned: 0 in 0.379s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" released by "_copy_volume_from_snapshot" :: held 8.216s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-5465cbc5-d82b-4586-836c-83a8cdb9e292-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" released by "_create_volume_from_snapshot" :: held 8.305s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.325s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.960s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139811363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c1d398-a79c-4597-a424-4ae2b8be2349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:03Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Creating volume 56c1d398-a79c-4597-a424-4ae2b8be2349 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:11 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:11 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 1073741824 Sep 07 16:54:11 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503fcf95-f4c9-4e25-baa6-98b6a1e7787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5', 'volume_size': 1, 'snapshot_id': '5465cbc5-d82b-4586-836c-83a8cdb9e292'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7fffff-742c-4ec2-840b-3ed82c55e369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:11 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Volume volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 (ad8b56a3-0c81-4833-9ebc-a068a5f583b5): created successfully Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7fffff-742c-4ec2-840b-3ed82c55e369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Flow 'volume_create_manager' (5d88613b-3a8a-43e1-9c0b-9730c4860054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c558e6d9-e8ad-4e1c-8f07-5f4d8c6792e2 tempest-VolumeDependencyTests-2353420 None] Created volume successfully. Sep 07 16:54:11 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 1073741824" returned: 0 in 0.557s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:11 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 Sep 07 16:54:11 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-5465cbc5-d82b-4586-836c-83a8cdb9e292-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Lock "cinder-5465cbc5-d82b-4586-836c-83a8cdb9e292-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-quobyte-472337c3-c7f1-44df-b050-b7647c61f986" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-472337c3-c7f1-44df-b050-b7647c61f986" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-quobyte-5465cbc5-d82b-4586-836c-83a8cdb9e292" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-5465cbc5-d82b-4586-836c-83a8cdb9e292" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Deleting offline snapshot 5465cbc5-d82b-4586-836c-83a8cdb9e292 of volume 472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] snapshot_file for this snap is: volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1819291-f918-42ca-b9b4-b9bf481966bc]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:12 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:12 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 Sep 07 16:54:12 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349" returned: 0 in 0.423s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.473s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326402252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:04Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Creating volume 6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:12 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:12 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 1073741824 Sep 07 16:54:12 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e92ee1b-7a04-4925-bdd0-25ea274301a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c1d398-a79c-4597-a424-4ae2b8be2349', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb045cf-56a9-4550-b63e-30dd5c400ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:12 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Volume volume-56c1d398-a79c-4597-a424-4ae2b8be2349 (56c1d398-a79c-4597-a424-4ae2b8be2349): created successfully Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adb045cf-56a9-4550-b63e-30dd5c400ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (74be8c0d-8289-4249-8018-ec29aee924a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:12 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c7e9c20c-563c-43d5-a449-618ebb48bdb1 tempest-CreateVolumesFromImageTest-521005999 None] Created volume successfully. Sep 07 16:54:12 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292" returned: 0 in 0.559s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-472337c3-c7f1-44df-b050-b7647c61f986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1cb40-3b29-4d04-a035-558642f972f4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:12 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 Sep 07 16:54:12 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:13 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 1073741824" returned: 0 in 0.942s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:13 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 Sep 07 16:54:13 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:13 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986" returned: 0 in 0.886s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:13 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 Sep 07 16:54:13 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:13 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.183s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1824458802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616d9030-88e3-404b-8936-0e922a4f5c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:04Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Creating volume 616d9030-88e3-404b-8936-0e922a4f5c49 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:13 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d188b5b-c457-4eea-a640-6efb4532d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6e2897-4afe-4243-b222-080818ca74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:13 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 1073741824 Sep 07 16:54:13 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Volume volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 (6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9): created successfully Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6e2897-4afe-4243-b222-080818ca74a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (832b3cf1-be5a-4a2d-a9d3-c73c13fbdd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e2da3091-9b52-4ac6-8b1f-c9c25f1a8a9d tempest-CreateVolumesFromImageTest-521005999 None] Created volume successfully. Sep 07 16:54:13 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292" returned: 0 in 0.443s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:14 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292 Sep 07 16:54:14 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:14 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986.5465cbc5-d82b-4586-836c-83a8cdb9e292" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:14 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 1073741824" returned: 0 in 0.682s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-5465cbc5-d82b-4586-836c-83a8cdb9e292" released by "_delete_snapshot" :: held 2.397s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-472337c3-c7f1-44df-b050-b7647c61f986" released by "delete_snapshot" :: held 2.424s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:14 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 Sep 07 16:54:14 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Created reservations ['96b31eda-eedc-4818-9bb3-2b153c00d590', 'f6dc8547-76c3-4696-ab09-f6b9b9268c74', 'bc651255-1e5d-4b55-875d-52a5be609f0d', '000596ef-1880-4f0a-9b77-6041957ed49b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:14 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Delete snapshot completed successfully. Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad60579c-beeb-42e6-a96b-aed9a742defd tempest-VolumeDependencyTests-2353420 None] Lock "cinder-5465cbc5-d82b-4586-836c-83a8cdb9e292-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:14 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49" returned: 0 in 0.332s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.475s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-707030337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edea7af1-4640-4d48-b571-81c6a2bef388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:05Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Creating volume edea7af1-4640-4d48-b571-81c6a2bef388 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:14 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:14 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 1073741824 Sep 07 16:54:14 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fb5edb-0dbc-4eb2-af82-dd9866f8c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616d9030-88e3-404b-8936-0e922a4f5c49', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b59e1a-c669-4410-89e1-7b00ba82dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Volume volume-616d9030-88e3-404b-8936-0e922a4f5c49 (616d9030-88e3-404b-8936-0e922a4f5c49): created successfully Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b59e1a-c669-4410-89e1-7b00ba82dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (b1283f42-ccbb-4614-ad2f-0c13e1739288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:14 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-36639ad7-ee47-4b16-8f64-408660f648fa tempest-CreateVolumesFromImageTest-521005999 None] Created volume successfully. Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (828002ab-5fe3-4676-bcef-9b0c5ece492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6677e5-d1fe-41ab-bb1e-869dd5ebdd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6677e5-d1fe-41ab-bb1e-869dd5ebdd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-735151613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97e6888-d03a-4b17-a85d-912aa74a03e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:15Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a669ed0b-9a61-4de7-a986-8081191af78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a669ed0b-9a61-4de7-a986-8081191af78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f9f753-f761-488e-8972-0e810c413b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f9f753-f761-488e-8972-0e810c413b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97e6888-d03a-4b17-a85d-912aa74a03e0', 'volume_name': 'volume-c97e6888-d03a-4b17-a85d-912aa74a03e0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cfeef1-f2f3-4049-9afc-917ac54ef7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cfeef1-f2f3-4049-9afc-917ac54ef7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389283b7-5dc1-478a-9adb-110f3713be17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:15 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Volume c97e6888-d03a-4b17-a85d-912aa74a03e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97e6888-d03a-4b17-a85d-912aa74a03e0', 'volume_size': 1} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-472337c3-c7f1-44df-b050-b7647c61f986-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-472337c3-c7f1-44df-b050-b7647c61f986-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-quobyte-472337c3-c7f1-44df-b050-b7647c61f986" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-472337c3-c7f1-44df-b050-b7647c61f986" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:15 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 1073741824" returned: 0 in 0.583s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b017b1-177d-4902-bdf3-3cea0efc6476]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:15 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 Sep 07 16:54:15 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:15 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 Sep 07 16:54:15 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:15 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.582s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1359972963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe96e90-7965-4adb-8edd-bb0c9e7a8611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fde1622dd44fc2988002086a857031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:07Z,use_quota=True,user_id='36d418d308da44d7b61c71eaf4a7e273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Creating volume ebe96e90-7965-4adb-8edd-bb0c9e7a8611 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:15 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:15 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 1073741824 Sep 07 16:54:15 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcbf437-bb5f-4a3a-a9aa-36f4f93d5e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edea7af1-4640-4d48-b571-81c6a2bef388', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ee8efb-7321-426b-8d2a-65227779ff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:15 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Volume volume-edea7af1-4640-4d48-b571-81c6a2bef388 (edea7af1-4640-4d48-b571-81c6a2bef388): created successfully Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ee8efb-7321-426b-8d2a-65227779ff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (1ecb3228-69bd-4c64-9674-ad44ba541cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:15 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2858fbd8-abf0-4545-8e0b-5c3bce7183fe tempest-CreateVolumesFromImageTest-521005999 None] Created volume successfully. Sep 07 16:54:15 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986" returned: 0 in 0.432s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:15 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986 Sep 07 16:54:15 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:16 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-472337c3-c7f1-44df-b050-b7647c61f986" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-472337c3-c7f1-44df-b050-b7647c61f986" released by "delete_volume" :: held 0.790s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:16 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 1073741824" returned: 0 in 0.469s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Created reservations ['e1de22e9-9907-43f1-9862-6bc6fe5109e5', '9f6e935b-b481-4575-afa1-5c3083b80efa', 'df080807-c35b-4855-89d7-daaba0846c23', 'd4b3a78b-8c95-4e9e-a1db-4447e46bccae'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:16 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 Sep 07 16:54:16 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:16 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:16 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-ad8b56a3-0c81-4833-9ebc-a068a5f583b5-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-ad8b56a3-0c81-4833-9ebc-a068a5f583b5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:16 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611" returned: 0 in 0.339s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-735151613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97e6888-d03a-4b17-a85d-912aa74a03e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:15Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Creating volume c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:16 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:16 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "cinder-quobyte-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d03c153-0779-48d7-82df-21181b11447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35fbc1b-098b-4340-a79f-39c8df184f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:16 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 1073741824 Sep 07 16:54:16 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Deleted volume successfully. Sep 07 16:54:16 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Volume volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 (ebe96e90-7965-4adb-8edd-bb0c9e7a8611): created successfully Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35fbc1b-098b-4340-a79f-39c8df184f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Flow 'volume_create_manager' (c5044627-103b-4dc7-aac4-f6961ca11bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" acquired by "delete_volume" :: waited 0.070s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b0be36c2-1760-4bb7-8c8c-e75a92cabc0d tempest-CreateVolumesFromImageTest-521005999 None] Created volume successfully. Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11f23663-c16f-4f03-be25-0d32de2b98f7 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-472337c3-c7f1-44df-b050-b7647c61f986-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[915dced1-756b-4606-9972-58371b367898]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-ebe96e90-7965-4adb-8edd-bb0c9e7a8611-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-ebe96e90-7965-4adb-8edd-bb0c9e7a8611-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-quobyte-ebe96e90-7965-4adb-8edd-bb0c9e7a8611" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:16 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 Sep 07 16:54:16 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-ebe96e90-7965-4adb-8edd-bb0c9e7a8611" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[af769d1b-4057-4979-9c10-dd22f8056418]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:17 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 Sep 07 16:54:17 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:17 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 1073741824" returned: 0 in 0.636s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:17 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 Sep 07 16:54:17 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:17 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" returned: 0 in 0.590s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:17 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5 Sep 07 16:54:17 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:17 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611" returned: 0 in 0.464s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:17 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611 Sep 07 16:54:17 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:17 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0" returned: 0 in 0.356s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389283b7-5dc1-478a-9adb-110f3713be17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97e6888-d03a-4b17-a85d-912aa74a03e0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664ad8e3-1c07-42cd-b12e-31318832c86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:17 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" returned: 0 in 0.348s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Volume volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 (c97e6888-d03a-4b17-a85d-912aa74a03e0): created successfully Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664ad8e3-1c07-42cd-b12e-31318832c86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (828002ab-5fe3-4676-bcef-9b0c5ece492e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-quobyte-ad8b56a3-0c81-4833-9ebc-a068a5f583b5" released by "delete_volume" :: held 1.039s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:17 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e194574b-0200-4e94-b9e4-03a398749efd tempest-VolumesSnapshotTestJSON-1708725501 None] Created volume successfully. Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Created reservations ['d163b216-e7b7-4c97-af14-45b80534ec9b', '36b4e656-ed21-448a-a117-b4495170ccf2', 'b07cea2b-73f8-4f14-a943-e616820ca8e8', 'bd90052a-3bef-4109-aa1a-b187877842e4'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:17 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ebe96e90-7965-4adb-8edd-bb0c9e7a8611" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-ebe96e90-7965-4adb-8edd-bb0c9e7a8611" released by "delete_volume" :: held 0.876s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:17 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:17 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:17 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Created reservations ['d914de5a-b4da-4935-aca9-bc94bc51815c', '014463e8-3c36-4a7f-bf3d-ea78669cd411', 'eedbd977-f084-425f-b271-7c1988f6f7a7', 'fcf60a38-697c-429e-a191-aa3efd2f8366'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:18 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:18 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:18 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.339s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Deleted volume successfully. Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-427af677-e67f-43d6-9a9c-012fc2708d67 tempest-VolumeDependencyTests-2353420 None] Lock "cinder-ad8b56a3-0c81-4833-9ebc-a068a5f583b5-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:18 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.321s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Deleted volume successfully. Sep 07 16:54:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2a15bcd2-ca4a-43cb-b809-961b8f4b1d70 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-ebe96e90-7965-4adb-8edd-bb0c9e7a8611-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-edea7af1-4640-4d48-b571-81c6a2bef388-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-edea7af1-4640-4d48-b571-81c6a2bef388-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Creating offline snapshot 1ff95f1b-cacb-4476-94d8-60c56cf47fa9 of volume c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ba6080-3f29-4f00-9110-a74548f46a0d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-quobyte-edea7af1-4640-4d48-b571-81c6a2bef388" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-edea7af1-4640-4d48-b571-81c6a2bef388" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ade58b-7485-437e-b981-0989378aeb02]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:19 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 Sep 07 16:54:19 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:19 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 Sep 07 16:54:19 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:19 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0" returned: 0 in 0.500s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:19 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 1G Sep 07 16:54:19 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:19 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388" returned: 0 in 0.453s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:19 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388 Sep 07 16:54:19 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:20 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-edea7af1-4640-4d48-b571-81c6a2bef388" returned: 0 in 0.347s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-edea7af1-4640-4d48-b571-81c6a2bef388" released by "delete_volume" :: held 0.887s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Created reservations ['7e5a057e-73fc-45e9-acdb-53ad666860f0', 'ceca0d01-f181-4e5b-b7d5-ee4b9f28de4e', '4bf73437-aab1-4184-b5ce-901991495190', 'd6dba2e6-a981-49f2-8538-bdfbe4d87acd'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:20 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 1G" returned: 0 in 0.560s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:20 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 Sep 07 16:54:20 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:20 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:20 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-616d9030-88e3-404b-8936-0e922a4f5c49-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-616d9030-88e3-404b-8936-0e922a4f5c49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-quobyte-616d9030-88e3-404b-8936-0e922a4f5c49" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-616d9030-88e3-404b-8936-0e922a4f5c49" acquired by "delete_volume" :: waited 0.036s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3024297c-37de-4450-b01a-8696761ca86b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:20 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9" returned: 0 in 0.447s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:20 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 is being set with open permissions: ugo+rw Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:20 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 Sep 07 16:54:20 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:20 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 Sep 07 16:54:20 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:20 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.493s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:20 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Deleted volume successfully. Sep 07 16:54:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-680f3fe7-f8be-4f2d-8814-3a5f164612ed tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-edea7af1-4640-4d48-b571-81c6a2bef388-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:21 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49" returned: 0 in 0.439s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:21 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9" returned: 0 in 0.390s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:21 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49 Sep 07 16:54:21 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:21 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.info Sep 07 16:54:21 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:21 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-616d9030-88e3-404b-8936-0e922a4f5c49" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-616d9030-88e3-404b-8936-0e922a4f5c49" released by "delete_volume" :: held 0.800s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Created reservations ['503e85c8-14da-4418-98ea-98ca356fb099', 'd5ce1789-a137-4d4e-8b05-f3d9c6dcd0c7', 'd2aedfd1-90d9-4910-9566-d01ec7c72d53', '4f048653-a673-47d8-a70c-8dfc7b60e73d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:21 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.info" returned: 0 in 0.348s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:21 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.info is being set with open permissions: ugo+rw Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:21 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.info Sep 07 16:54:21 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:21 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:21 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-quobyte-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9" acquired by "delete_volume" :: waited 0.037s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:21 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387262c-5baf-4264-805c-c4df9cfb260a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.348s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Deleted volume successfully. Sep 07 16:54:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f9078bcc-e0cc-4461-ac69-88e9c5834357 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-616d9030-88e3-404b-8936-0e922a4f5c49-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:22 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.info" returned: 0 in 0.517s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:22 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 Sep 07 16:54:22 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d6340199-4542-4c48-bb10-eece6ac141c6 tempest-VolumesSnapshotTestJSON-1708725501 None] Create snapshot completed successfully Sep 07 16:54:22 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9" returned: 0 in 0.435s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:22 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9 Sep 07 16:54:22 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-1ff95f1b-cacb-4476-94d8-60c56cf47fa9-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-1ff95f1b-cacb-4476-94d8-60c56cf47fa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-c97e6888-d03a-4b17-a85d-912aa74a03e0" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-c97e6888-d03a-4b17-a85d-912aa74a03e0" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-1ff95f1b-cacb-4476-94d8-60c56cf47fa9" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-1ff95f1b-cacb-4476-94d8-60c56cf47fa9" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Deleting offline snapshot 1ff95f1b-cacb-4476-94d8-60c56cf47fa9 of volume c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] snapshot_file for this snap is: volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfb0218-96e4-4719-8951-c22084049d41]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:22 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9" returned: 0 in 0.398s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9" released by "delete_volume" :: held 0.905s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:22 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Created reservations ['17b65bd8-8d91-4ad3-8fcd-ef35715c8eaf', '10f6b9c0-13b4-42b5-8a1c-aa427f38a59c', '1af99fba-d050-4870-ac8b-8e4e6c097ac4', 'd1a30edf-17bb-4ab7-b3cf-12c80060156b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:22 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 Sep 07 16:54:22 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:23 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:23 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:23 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9" returned: 0 in 0.579s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97e6888-d03a-4b17-a85d-912aa74a03e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a58b2-dda7-45bb-8657-2ac1ee275b4d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:23 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.339s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Deleted volume successfully. Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a0a2982f-45cf-4c52-9e27-25df2c75af51 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-6e1cdcb3-bd31-4bf2-82f4-d5fbaef16ff9-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:23 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 Sep 07 16:54:23 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:23 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0" returned: 0 in 0.458s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:23 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 Sep 07 16:54:23 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (e733bce9-9357-4bb4-b76f-9defa6f0e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc08269-78e8-4c37-9730-d909f53cbbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc08269-78e8-4c37-9730-d909f53cbbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410650071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2187fe6-cdfc-4221-b588-03fdce3da218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:24Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da2d0d5-807d-427a-81e9-ee5da8863e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da2d0d5-807d-427a-81e9-ee5da8863e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ceb2a7-0b65-4cf0-9914-ecbb4d6f87ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ceb2a7-0b65-4cf0-9914-ecbb4d6f87ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2187fe6-cdfc-4221-b588-03fdce3da218', 'volume_name': 'volume-e2187fe6-cdfc-4221-b588-03fdce3da218', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e692f3-b244-4fb0-9ca7-16839333cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e692f3-b244-4fb0-9ca7-16839333cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167bd061-b886-4003-9045-07110fcf8913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:24 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Volume e2187fe6-cdfc-4221-b588-03fdce3da218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2187fe6-cdfc-4221-b588-03fdce3da218', 'volume_size': 1} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410650071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2187fe6-cdfc-4221-b588-03fdce3da218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:24Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Creating volume e2187fe6-cdfc-4221-b588-03fdce3da218 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:24 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-56c1d398-a79c-4597-a424-4ae2b8be2349-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:24 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 1073741824 Sep 07 16:54:24 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-56c1d398-a79c-4597-a424-4ae2b8be2349-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "cinder-quobyte-56c1d398-a79c-4597-a424-4ae2b8be2349" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-56c1d398-a79c-4597-a424-4ae2b8be2349" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b109bc7-3c83-4346-b6d2-47e89bf2ec8f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:24 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9" returned: 0 in 0.481s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:24 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9 Sep 07 16:54:24 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:24 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 Sep 07 16:54:24 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:24 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0.1ff95f1b-cacb-4476-94d8-60c56cf47fa9" returned: 0 in 0.365s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:24 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 1073741824" returned: 0 in 0.634s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-1ff95f1b-cacb-4476-94d8-60c56cf47fa9" released by "_delete_snapshot" :: held 2.053s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-c97e6888-d03a-4b17-a85d-912aa74a03e0" released by "delete_snapshot" :: held 2.095s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:24 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349" returned: 0 in 0.497s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:24 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349 Sep 07 16:54:24 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:24 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 Sep 07 16:54:24 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['9575961d-1bba-4ead-9162-69c45aa94ede', 'cd271156-2c10-4f4a-bb9f-a6d429d5ec58', '105e7bee-fa3f-48eb-a2fc-2b8a96df45a6', 'caca2fe7-aab5-4563-887f-c7987f15a1c9'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:24 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Delete snapshot completed successfully. Sep 07 16:54:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6bc3382e-7c48-4e8a-9856-9932122176de tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-1ff95f1b-cacb-4476-94d8-60c56cf47fa9-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:25 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218" returned: 0 in 0.298s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167bd061-b886-4003-9045-07110fcf8913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2187fe6-cdfc-4221-b588-03fdce3da218', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:25 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275e7573-9e7b-4b31-816f-547139839d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56c1d398-a79c-4597-a424-4ae2b8be2349" returned: 0 in 0.369s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-quobyte-56c1d398-a79c-4597-a424-4ae2b8be2349" released by "delete_volume" :: held 0.925s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Volume volume-e2187fe6-cdfc-4221-b588-03fdce3da218 (e2187fe6-cdfc-4221-b588-03fdce3da218): created successfully Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275e7573-9e7b-4b31-816f-547139839d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (e733bce9-9357-4bb4-b76f-9defa6f0e84d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a6db851b-f25c-435e-9447-5b9fab3bf709 tempest-ProjectReaderTests-258644507 None] Created volume successfully. Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Created reservations ['62df26ae-b07e-491d-b4b2-66266e119e7d', '1395aabc-70ff-42ab-bfba-372de5c2504e', 'd508337f-7898-49fb-b6de-8fc336eb9d48', 'fdc7d3e3-3c69-4657-9183-4d7cbb6a6373'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:25 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:25 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:25 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.282s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Deleted volume successfully. Sep 07 16:54:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2dadfc14-698c-4fb1-981c-8ebbd9cea050 tempest-CreateVolumesFromImageTest-521005999 None] Lock "cinder-56c1d398-a79c-4597-a424-4ae2b8be2349-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-e2187fe6-cdfc-4221-b588-03fdce3da218-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Lock "cinder-e2187fe6-cdfc-4221-b588-03fdce3da218-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-quobyte-e2187fe6-cdfc-4221-b588-03fdce3da218" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-e2187fe6-cdfc-4221-b588-03fdce3da218" acquired by "delete_volume" :: waited 0.041s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (62c22b11-d6ba-45ad-af30-1e69a82bdc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2b74ea-21c3-464a-86b1-d8a22208d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1e8b5-7f3f-439b-b15c-ba89a90eb86b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2b74ea-21c3-464a-86b1-d8a22208d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1014306104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955b22e0-90c3-4597-b1b3-c541585555b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:26Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29fc92e-7e04-402d-a5aa-28f8974b0061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e29fc92e-7e04-402d-a5aa-28f8974b0061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d805b8-75ce-457a-98f7-e0ec2633e223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d805b8-75ce-457a-98f7-e0ec2633e223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955b22e0-90c3-4597-b1b3-c541585555b0', 'volume_name': 'volume-955b22e0-90c3-4597-b1b3-c541585555b0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657e94d5-3ae4-47fd-acd9-639344f75ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657e94d5-3ae4-47fd-acd9-639344f75ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f772bc6a-c4a7-4b71-ad8b-986f52229a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Volume 955b22e0-90c3-4597-b1b3-c541585555b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955b22e0-90c3-4597-b1b3-c541585555b0', 'volume_size': 1} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1014306104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955b22e0-90c3-4597-b1b3-c541585555b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:26Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Creating volume 955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:26 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:26 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 1073741824 Sep 07 16:54:26 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:26 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 Sep 07 16:54:26 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:27 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218" returned: 0 in 0.511s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:27 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218 Sep 07 16:54:27 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:27 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 1073741824" returned: 0 in 0.573s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:27 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 Sep 07 16:54:27 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:27 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2187fe6-cdfc-4221-b588-03fdce3da218" returned: 0 in 0.400s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-e2187fe6-cdfc-4221-b588-03fdce3da218" released by "delete_volume" :: held 1.005s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Created reservations ['16497237-8390-40c8-ba05-313c79a9bfc9', 'fa01fa75-e8c7-4a45-87e8-10b1c9e2e15f', '413650cd-a811-4003-9b9f-cda231de04ee', '738ec53f-a9cf-449a-88a6-07cb74df2b0a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:27 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0" returned: 0 in 0.332s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f772bc6a-c4a7-4b71-ad8b-986f52229a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955b22e0-90c3-4597-b1b3-c541585555b0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fcf480-cda6-462c-a6cc-1d444a93dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:27 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Volume volume-955b22e0-90c3-4597-b1b3-c541585555b0 (955b22e0-90c3-4597-b1b3-c541585555b0): created successfully Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fcf480-cda6-462c-a6cc-1d444a93dfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (62c22b11-d6ba-45ad-af30-1e69a82bdc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:27 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:27 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a6fa8b8f-f4b6-435d-afae-f52a01978797 tempest-VolumesSnapshotTestJSON-1708725501 None] Created volume successfully. Sep 07 16:54:28 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:28 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Deleted volume successfully. Sep 07 16:54:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-580b4b8c-4f51-4e0c-a1dc-8db4e928c4fb tempest-ProjectReaderTests-258644507 None] Lock "cinder-e2187fe6-cdfc-4221-b588-03fdce3da218-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Creating offline snapshot 2af6c1e5-dc23-4494-8b14-d560e92ae32e of volume 955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (1f38f393-6306-44b7-8f61-1ea66e41b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8fd20b-625a-48a1-b6fe-0deaf07100b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9297586-b992-4e01-a318-b1115b5c81f3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8fd20b-625a-48a1-b6fe-0deaf07100b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088500243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c2a6ac-f41b-447b-935c-f5abd7b72a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:29Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed36825-f84a-48e4-821b-ccde6194f4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed36825-f84a-48e4-821b-ccde6194f4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbda914f-22ae-4583-9756-6d26c962882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbda914f-22ae-4583-9756-6d26c962882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c2a6ac-f41b-447b-935c-f5abd7b72a09', 'volume_name': 'volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f63df5-6a64-41bc-afad-5b32ece55b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f63df5-6a64-41bc-afad-5b32ece55b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea221c55-d99c-4fec-a697-257f7bbf3715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume 68c2a6ac-f41b-447b-935c-f5abd7b72a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09', 'volume_size': 1} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:29 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 Sep 07 16:54:29 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (983916b4-d59b-4acc-a5f2-6bf441f593b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99880f56-9765-4850-a16a-7321fdc77b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99880f56-9765-4850-a16a-7321fdc77b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875072190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb051c8-e0f9-4947-8cc3-4b9c318e9a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:29Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05834cc0-28e6-4c45-9b53-6f6455516e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05834cc0-28e6-4c45-9b53-6f6455516e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd60dc0-8229-40a2-aca8-cc2cd1f6a07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd60dc0-8229-40a2-aca8-cc2cd1f6a07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb051c8-e0f9-4947-8cc3-4b9c318e9a23', 'volume_name': 'volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6342326a-5cf6-408a-8f7d-7602d4564d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6342326a-5cf6-408a-8f7d-7602d4564d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fee8662-7d71-4a52-baa9-2cd5c9274723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Volume 6cb051c8-e0f9-4947-8cc3-4b9c318e9a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23', 'volume_size': 1} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:29 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0" returned: 0 in 0.480s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:29 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e 1G Sep 07 16:54:29 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:30 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e 1G" returned: 0 in 0.462s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955b22e0-90c3-4597-b1b3-c541585555b0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:30 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955b22e0-90c3-4597-b1b3-c541585555b0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e Sep 07 16:54:30 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:30 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-955b22e0-90c3-4597-b1b3-c541585555b0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e" returned: 0 in 0.311s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:30 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e is being set with open permissions: ugo+rw Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:30 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e Sep 07 16:54:30 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:30 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=128,cinder:INSERT=50,cinder:UPDATE=184,cinder:DELETE=12 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=140,cinder:UPDATE=159,cinder:INSERT=42,cinder:DELETE=18 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:30 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.info Sep 07 16:54:30 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:30 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.info" returned: 0 in 0.272s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:30 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.info is being set with open permissions: ugo+rw Sep 07 16:54:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:30 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.info Sep 07 16:54:30 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Flow 'volume_create_manager' (ddc4bfac-3be2-4184-846e-d0ea5d1afb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6ea776-a3d7-445d-9fce-8167c72ed7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6ea776-a3d7-445d-9fce-8167c72ed7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-568588156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12769568-ef84-4276-b50a-2e2a259ac523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920fdebe00f14bf393e51015bc3b041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:31Z,use_quota=True,user_id='f108a13b87974c13b097e465d57338b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:31 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060a6fde-2ae7-4bbd-8309-c989b86e6ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060a6fde-2ae7-4bbd-8309-c989b86e6ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db5d3e8-bc77-494d-98c4-0900ebcc6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db5d3e8-bc77-494d-98c4-0900ebcc6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12769568-ef84-4276-b50a-2e2a259ac523', 'volume_name': 'volume-12769568-ef84-4276-b50a-2e2a259ac523', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b100faf-90ad-4643-a22c-1aa3b4bb0c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b100faf-90ad-4643-a22c-1aa3b4bb0c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d82a84-6c9e-4a5a-a38d-ab8860777fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:31 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Volume 12769568-ef84-4276-b50a-2e2a259ac523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12769568-ef84-4276-b50a-2e2a259ac523', 'volume_size': 1} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.info" returned: 0 in 0.311s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1088500243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c2a6ac-f41b-447b-935c-f5abd7b72a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:29Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Creating volume 68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:31 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:31 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 1073741824 Sep 07 16:54:31 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6d1c2dfb-886e-49e4-b953-9a5217d2d0c1 tempest-VolumesSnapshotTestJSON-1708725501 None] Create snapshot completed successfully Sep 07 16:54:31 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 1073741824" returned: 0 in 0.442s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:31 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 Sep 07 16:54:31 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:32 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09" returned: 0 in 0.276s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875072190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb051c8-e0f9-4947-8cc3-4b9c318e9a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:29Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Creating volume 6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:32 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:32 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 1073741824 Sep 07 16:54:32 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea221c55-d99c-4fec-a697-257f7bbf3715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d57afa-111f-4cc8-96a3-db1a626c7b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 (68c2a6ac-f41b-447b-935c-f5abd7b72a09): created successfully Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d57afa-111f-4cc8-96a3-db1a626c7b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (1f38f393-6306-44b7-8f61-1ea66e41b101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-aa859b92-853f-41ae-b2a1-3f8c942a558c tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created volume successfully. Sep 07 16:54:32 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 1073741824" returned: 0 in 0.486s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (e94f3881-6417-4d55-bb43-f9e82f3bf068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e85b5-986f-4d6e-b57d-5a9bed2f662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039e85b5-986f-4d6e-b57d-5a9bed2f662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2041769533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca1d772-7920-4a8d-a931-5eeddf60c9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2af6c1e5-dc23-4494-8b14-d560e92ae32e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:32Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdc8269-9799-4c29-95bc-689e4c41bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:32 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 Sep 07 16:54:32 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdc8269-9799-4c29-95bc-689e4c41bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c94c251-563e-4c90-9e2a-3cfba77de021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c94c251-563e-4c90-9e2a-3cfba77de021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aca1d772-7920-4a8d-a931-5eeddf60c9fc', 'volume_name': 'volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc', 'volume_size': 2, 'snapshot_id': '2af6c1e5-dc23-4494-8b14-d560e92ae32e'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ebfb7d-c341-48be-a3ab-cbdfade10030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ebfb7d-c341-48be-a3ab-cbdfade10030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7e50f2-5d5b-477e-b3e7-0295a2fced2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Volume aca1d772-7920-4a8d-a931-5eeddf60c9fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc', 'volume_size': 2, 'snapshot_id': '2af6c1e5-dc23-4494-8b14-d560e92ae32e'} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:32 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.637s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-568588156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12769568-ef84-4276-b50a-2e2a259ac523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='920fdebe00f14bf393e51015bc3b041a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:31Z,use_quota=True,user_id='f108a13b87974c13b097e465d57338b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Creating volume 12769568-ef84-4276-b50a-2e2a259ac523 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:32 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fee8662-7d71-4a52-baa9-2cd5c9274723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11db724a-0d48-4e9b-bb1f-2d9cf80aedaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:32 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 1073741824 Sep 07 16:54:32 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Volume volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 (6cb051c8-e0f9-4947-8cc3-4b9c318e9a23): created successfully Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11db724a-0d48-4e9b-bb1f-2d9cf80aedaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (983916b4-d59b-4acc-a5f2-6bf441f593b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-81e2d293-4f5a-40bc-ad62-267f352df93e tempest-ProjectReaderTests-258644507 None] Created volume successfully. Sep 07 16:54:33 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 1073741824" returned: 0 in 0.499s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:33 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 Sep 07 16:54:33 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:33 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:33 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:33 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:33 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523" returned: 0 in 0.270s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.026s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-2af6c1e5-dc23-4494-8b14-d560e92ae32e-aca1d772-7920-4a8d-a931-5eeddf60c9fc" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Lock "cinder-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03d82a84-6c9e-4a5a-a38d-ab8860777fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12769568-ef84-4276-b50a-2e2a259ac523', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1e90f8-7f19-4955-aca1-461effc87ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-2af6c1e5-dc23-4494-8b14-d560e92ae32e-aca1d772-7920-4a8d-a931-5eeddf60c9fc" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Creating volume aca1d772-7920-4a8d-a931-5eeddf60c9fc from snapshot 2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-aca1d772-7920-4a8d-a931-5eeddf60c9fc" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:33 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Volume volume-12769568-ef84-4276-b50a-2e2a259ac523 (12769568-ef84-4276-b50a-2e2a259ac523): created successfully Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1e90f8-7f19-4955-aca1-461effc87ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Flow 'volume_create_manager' (ddc4bfac-3be2-4184-846e-d0ea5d1afb2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-aca1d772-7920-4a8d-a931-5eeddf60c9fc" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] snapshot: 2af6c1e5-dc23-4494-8b14-d560e92ae32e, volume: aca1d772-7920-4a8d-a931-5eeddf60c9fc, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:54:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a5f24642-7b2b-4e18-a286-6760ed3268ef tempest-AbsoluteLimitsTests-724443314 None] Created volume successfully. Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-quobyte-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23" acquired by "delete_volume" :: waited 0.038s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0b1c23-facd-46f5-9a54-f6e853d9edb9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5264ae-9ba8-4388-81d0-7b62f961694f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:33 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e Sep 07 16:54:33 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:33 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 Sep 07 16:54:33 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:34 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e" returned: 0 in 0.429s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-955b22e0-90c3-4597-b1b3-c541585555b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:54:34 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23" returned: 0 in 0.438s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed374568-8b85-41be-b25a-5e78ad1ba091]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:34 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23 Sep 07 16:54:34 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:34 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 Sep 07 16:54:34 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Acquiring lock "cinder-12769568-ef84-4276-b50a-2e2a259ac523-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Lock "cinder-12769568-ef84-4276-b50a-2e2a259ac523-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:34 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23" returned: 0 in 0.344s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Acquiring lock "cinder-quobyte-12769568-ef84-4276-b50a-2e2a259ac523" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23" released by "delete_volume" :: held 0.824s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Lock "cinder-quobyte-12769568-ef84-4276-b50a-2e2a259ac523" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f0861e-8450-4768-b817-5466ceb21db0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Created reservations ['c3d8042a-916d-4935-884e-f530b893e807', 'd8a25e27-0f76-44fe-b56f-9e0f60a16d06', 'cecc3369-07a8-4732-8352-2653b8fd58c7', '2746fa4c-69a4-4dc1-9f02-4a06d08df2ec'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:34 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0" returned: 0 in 0.446s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:34 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc Sep 07 16:54:34 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:34 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 Sep 07 16:54:34 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:34 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:34 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:35 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:35 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.259s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523" returned: 0 in 0.463s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:35 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Deleted volume successfully. Sep 07 16:54:35 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523 Sep 07 16:54:35 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c468dd87-4adb-4c79-a4b0-c5496f76a4b8 tempest-ProjectReaderTests-258644507 None] Lock "cinder-6cb051c8-e0f9-4947-8cc3-4b9c318e9a23-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:35 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-12769568-ef84-4276-b50a-2e2a259ac523" returned: 0 in 0.482s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Lock "cinder-quobyte-12769568-ef84-4276-b50a-2e2a259ac523" released by "delete_volume" :: held 0.999s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Created reservations ['fa69bb45-17ff-412b-8078-0d05681bffa5', 'bbf6ee14-2b86-4918-bc33-62fac68ff7da', 'afd27863-e931-4207-b16f-02d788bfa162', 'ae0b3dd5-e53a-4d92-af08-cc139e13b1a3'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:36 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:36 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:36 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.563s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:36 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Deleted volume successfully. Sep 07 16:54:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c31488cd-0a47-493e-810b-857795e9f481 tempest-AbsoluteLimitsTests-724443314 None] Lock "cinder-12769568-ef84-4276-b50a-2e2a259ac523-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (c4175942-d57f-4922-b745-c2c7ba1f7c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63754591-20a9-4622-aba8-57eec1724a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63754591-20a9-4622-aba8-57eec1724a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1124561342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8baf50c-6789-4877-b2d9-b72000f4d734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:37Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55ee3be-90e3-4570-85e7-523770839e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55ee3be-90e3-4570-85e7-523770839e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1700bf59-7bd4-4bd9-a52d-7f8206a5356f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1700bf59-7bd4-4bd9-a52d-7f8206a5356f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8baf50c-6789-4877-b2d9-b72000f4d734', 'volume_name': 'volume-a8baf50c-6789-4877-b2d9-b72000f4d734', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cad1c5a-a538-405b-802d-a88b725ce44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cad1c5a-a538-405b-802d-a88b725ce44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa07c20-775b-4635-8345-0d9df4eda0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:37 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Volume a8baf50c-6789-4877-b2d9-b72000f4d734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8baf50c-6789-4877-b2d9-b72000f4d734', 'volume_size': 1} Sep 07 16:54:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:39 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc" returned: 0 in 5.135s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:39 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:54:39 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Converted 1024.00 MB image at 199.38 MB/s Sep 07 16:54:39 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc is being set with open permissions: ugo+rw Sep 07 16:54:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:39 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc Sep 07 16:54:39 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:40 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc" returned: 0 in 0.307s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-aca1d772-7920-4a8d-a931-5eeddf60c9fc" released by "_copy_volume_from_snapshot" :: held 6.449s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-2af6c1e5-dc23-4494-8b14-d560e92ae32e-aca1d772-7920-4a8d-a931-5eeddf60c9fc" released by "_create_volume_from_snapshot" :: held 6.538s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.593s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.894s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Creating offline snapshot 141c27bf-fc16-4a68-9c75-bfebf3d0e776 of volume 68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7e50f2-5d5b-477e-b3e7-0295a2fced2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc', 'volume_size': 2, 'snapshot_id': '2af6c1e5-dc23-4494-8b14-d560e92ae32e'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3043cb-81d0-449d-af27-a7d917889abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a4078-fbd1-41ec-a2d2-57b8384c74a3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:40 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Volume volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc (aca1d772-7920-4a8d-a931-5eeddf60c9fc): created successfully Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3043cb-81d0-449d-af27-a7d917889abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (e94f3881-6417-4d55-bb43-f9e82f3bf068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f56e46c8-68ea-4d79-a265-5b125841bf2a tempest-VolumesSnapshotTestJSON-1708725501 None] Created volume successfully. Sep 07 16:54:40 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 Sep 07 16:54:40 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:40 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09" returned: 0 in 0.388s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:40 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 1G Sep 07 16:54:40 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:41 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 1G" returned: 0 in 0.502s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:41 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 Sep 07 16:54:41 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-aca1d772-7920-4a8d-a931-5eeddf60c9fc-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-aca1d772-7920-4a8d-a931-5eeddf60c9fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-aca1d772-7920-4a8d-a931-5eeddf60c9fc" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-aca1d772-7920-4a8d-a931-5eeddf60c9fc" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e72610b-cd87-4b17-8e6b-7e350c2a32f2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:41 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776" returned: 0 in 0.357s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:41 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 is being set with open permissions: ugo+rw Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:41 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 Sep 07 16:54:41 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:41 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc Sep 07 16:54:41 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:41 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776" returned: 0 in 0.317s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:41 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.info Sep 07 16:54:41 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:41 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc" returned: 0 in 0.460s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:42 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc Sep 07 16:54:42 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:42 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.info" returned: 0 in 0.257s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:42 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.info is being set with open permissions: ugo+rw Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:42 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.info Sep 07 16:54:42 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:42 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-aca1d772-7920-4a8d-a931-5eeddf60c9fc" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-aca1d772-7920-4a8d-a931-5eeddf60c9fc" released by "delete_volume" :: held 0.806s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['2a79c0d3-aea3-4ffe-9f04-c5c120212a0c', '4f4a030d-f246-4e01-8456-8a47856c4fd1', '420e6fcc-deec-4c65-b08b-5f04e4970e03', 'b832b534-345b-476f-bf55-761037bac38f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:42 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:42 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:42 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.info" returned: 0 in 0.285s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.997s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1124561342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8baf50c-6789-4877-b2d9-b72000f4d734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:37Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Creating volume a8baf50c-6789-4877-b2d9-b72000f4d734 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:42 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:42 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 1073741824 Sep 07 16:54:42 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:42 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b047a0cc-cb81-4bc9-8bf4-52672e5a9c85 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Create snapshot completed successfully Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-2af6c1e5-dc23-4494-8b14-d560e92ae32e-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-2af6c1e5-dc23-4494-8b14-d560e92ae32e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-955b22e0-90c3-4597-b1b3-c541585555b0" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-955b22e0-90c3-4597-b1b3-c541585555b0" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-2af6c1e5-dc23-4494-8b14-d560e92ae32e" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-2af6c1e5-dc23-4494-8b14-d560e92ae32e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Deleting offline snapshot 2af6c1e5-dc23-4494-8b14-d560e92ae32e of volume 955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:54:42 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] snapshot_file for this snap is: volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.347s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:42 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Deleted volume successfully. Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec254d6b-03f3-420d-a55b-2a5bc6b008f6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d7b47e04-d834-4093-9e27-96a06dc94cf2 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-aca1d772-7920-4a8d-a931-5eeddf60c9fc-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:42 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e Sep 07 16:54:42 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:43 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 1073741824" returned: 0 in 0.615s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:43 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 Sep 07 16:54:43 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:43 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e" returned: 0 in 0.487s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-955b22e0-90c3-4597-b1b3-c541585555b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a696ea2-9208-4f9d-85a1-55b584daba23]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:43 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 Sep 07 16:54:43 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:43 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734" returned: 0 in 0.445s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa07c20-775b-4635-8345-0d9df4eda0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8baf50c-6789-4877-b2d9-b72000f4d734', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780c45aa-ed5c-413c-92db-e07edb63d83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:43 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Volume volume-a8baf50c-6789-4877-b2d9-b72000f4d734 (a8baf50c-6789-4877-b2d9-b72000f4d734): created successfully Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780c45aa-ed5c-413c-92db-e07edb63d83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (c4175942-d57f-4922-b745-c2c7ba1f7c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9c1dd972-c9af-446f-8bb5-699dd414e390 tempest-ProjectReaderTests-258644507 None] Created volume successfully. Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (301c3583-e72c-405a-b783-845873d6510c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f26c2c2-b0bd-45fa-b215-e7bf1019af52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f26c2c2-b0bd-45fa-b215-e7bf1019af52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413670379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdfd6e9-15e3-4b55-b54f-daf19c81a45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:44Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1547a4fa-79fe-464c-82bd-a9ca555d341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1547a4fa-79fe-464c-82bd-a9ca555d341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c4d2ea-b247-4038-8524-90fcd418a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c4d2ea-b247-4038-8524-90fcd418a686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdfd6e9-15e3-4b55-b54f-daf19c81a45f', 'volume_name': 'volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89df426a-e4af-45f6-b722-fc95b8c7c2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89df426a-e4af-45f6-b722-fc95b8c7c2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3eb7a0-0230-4f5f-a2b7-749ce7dee404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:43 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume dfdfd6e9-15e3-4b55-b54f-daf19c81a45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f', 'volume_size': 1} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413670379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdfd6e9-15e3-4b55-b54f-daf19c81a45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:44Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Creating volume dfdfd6e9-15e3-4b55-b54f-daf19c81a45f {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:43 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:43 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f 1073741824 Sep 07 16:54:43 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:44 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0" returned: 0 in 0.888s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:44 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e Sep 07 16:54:44 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (05fcdb13-10a4-42eb-917d-3005e7cd0f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869e42b5-78ac-49e0-83bf-3251d46738f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869e42b5-78ac-49e0-83bf-3251d46738f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373617559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e0c384-24d6-4f91-adde-8086689cf630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:44Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584dfbd3-07ea-4eed-8bd8-8489b4087b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584dfbd3-07ea-4eed-8bd8-8489b4087b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a018ac4-c699-45c5-8090-e60af40dc344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a018ac4-c699-45c5-8090-e60af40dc344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e0c384-24d6-4f91-adde-8086689cf630', 'volume_name': 'volume-81e0c384-24d6-4f91-adde-8086689cf630', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef69c32a-3e22-420e-9918-48d06610123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef69c32a-3e22-420e-9918-48d06610123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330a59f5-ec79-498a-ac36-913c7216f4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume 81e0c384-24d6-4f91-adde-8086689cf630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e0c384-24d6-4f91-adde-8086689cf630', 'volume_size': 1} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:44 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f 1073741824" returned: 0 in 0.726s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:44 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f Sep 07 16:54:44 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (de1157ad-a158-4a34-ad15-ecc491038b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356d4ae4-e945-4c74-83bb-b883099863b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-a8baf50c-6789-4877-b2d9-b72000f4d734-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356d4ae4-e945-4c74-83bb-b883099863b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1247084670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:45Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b333ba-74f1-4a04-9740-d8f2ea838be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b333ba-74f1-4a04-9740-d8f2ea838be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d195f347-967b-4a4c-a546-90dd0dd719d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d195f347-967b-4a4c-a546-90dd0dd719d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84', 'volume_name': 'volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d6b88b-80dc-4067-b794-2bba900a5d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d6b88b-80dc-4067-b794-2bba900a5d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208f12f7-c622-485a-a7c6-a5552d8fee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:44 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume 7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84', 'volume_size': 1} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Lock "cinder-a8baf50c-6789-4877-b2d9-b72000f4d734-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e" returned: 0 in 0.694s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:45 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e Sep 07 16:54:45 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-quobyte-a8baf50c-6789-4877-b2d9-b72000f4d734" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-a8baf50c-6789-4877-b2d9-b72000f4d734" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961e918-ee59-4fd2-93df-86cd02b94b41]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:45 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f" returned: 0 in 0.393s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373617559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e0c384-24d6-4f91-adde-8086689cf630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:44Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Creating volume 81e0c384-24d6-4f91-adde-8086689cf630 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:45 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:45 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 1073741824 Sep 07 16:54:45 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:45 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 Sep 07 16:54:45 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3eb7a0-0230-4f5f-a2b7-749ce7dee404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0e58a9-3ebb-48d4-888d-2a4b35a2acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:45 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f (dfdfd6e9-15e3-4b55-b54f-daf19c81a45f): created successfully Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0e58a9-3ebb-48d4-888d-2a4b35a2acf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (301c3583-e72c-405a-b783-845873d6510c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6d37c538-583d-4559-9a9a-34caa604a328 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created volume successfully. Sep 07 16:54:45 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0.2af6c1e5-dc23-4494-8b14-d560e92ae32e" returned: 0 in 0.551s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-2af6c1e5-dc23-4494-8b14-d560e92ae32e" released by "_delete_snapshot" :: held 2.792s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-955b22e0-90c3-4597-b1b3-c541585555b0" released by "delete_snapshot" :: held 2.820s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:45 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734" returned: 0 in 0.554s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:45 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734 Sep 07 16:54:45 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (e7f44778-9497-4ec8-a607-c1d41d98c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c12e51-20b2-451c-9cdc-ce04b91f6497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c12e51-20b2-451c-9cdc-ce04b91f6497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038913478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:46Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774f5dc4-b489-4690-bede-3cb5acdf9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774f5dc4-b489-4690-bede-3cb5acdf9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4d9b5f-3f8e-4eba-b21d-359c87838a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4d9b5f-3f8e-4eba-b21d-359c87838a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e', 'volume_name': 'volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320413a6-9372-4ddb-99fc-147977bc91d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320413a6-9372-4ddb-99fc-147977bc91d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c97b47d-b0dc-43ac-af01-af91fe031374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:45 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume 37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e', 'volume_size': 1} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['f6e335fd-6391-40a2-b3c7-649e5b6d2238', '03cd9473-08fc-4cc6-a126-f808767e7fd1', '41a16d86-3fbf-44f8-8a44-aaa8a2b925aa', 'e8e0fe09-7fa5-4693-b788-d5cfc5ae0112'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:45 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 1073741824" returned: 0 in 0.728s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Delete snapshot completed successfully. Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bbf2b434-c379-480a-b38a-eccc2af13f10 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-2af6c1e5-dc23-4494-8b14-d560e92ae32e-delete_snapshot" released by "delete_snapshot" :: held 3.233s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:46 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 Sep 07 16:54:46 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:46 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-955b22e0-90c3-4597-b1b3-c541585555b0-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a8baf50c-6789-4877-b2d9-b72000f4d734" returned: 0 in 0.638s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (42800f69-888a-4007-82f3-78aca4d3a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5f14d2-3cfa-4918-bdb6-232518fc2f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-a8baf50c-6789-4877-b2d9-b72000f4d734" released by "delete_volume" :: held 1.318s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-955b22e0-90c3-4597-b1b3-c541585555b0-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5f14d2-3cfa-4918-bdb6-232518fc2f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685682862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56391054-7104-42ae-b1b4-08f9f1cd5140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:46Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:46 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dafe964-aee2-4528-9e54-85badedc25c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dafe964-aee2-4528-9e54-85badedc25c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598d155e-b923-447e-9888-ae1e884e6cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598d155e-b923-447e-9888-ae1e884e6cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56391054-7104-42ae-b1b4-08f9f1cd5140', 'volume_name': 'volume-56391054-7104-42ae-b1b4-08f9f1cd5140', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ee8a66-8ed8-43a5-92db-4d25b90df3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ee8a66-8ed8-43a5-92db-4d25b90df3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b6c26b-d858-48a3-a8e6-866e9f5806ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:46 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume 56391054-7104-42ae-b1b4-08f9f1cd5140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56391054-7104-42ae-b1b4-08f9f1cd5140', 'volume_size': 1} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630" returned: 0 in 0.465s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.522s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1247084670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:45Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Creating volume 7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:46 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:46 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 1073741824 Sep 07 16:54:46 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330a59f5-ec79-498a-ac36-913c7216f4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e0c384-24d6-4f91-adde-8086689cf630', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4076630-4666-492a-9132-3238a9019f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:46 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume volume-81e0c384-24d6-4f91-adde-8086689cf630 (81e0c384-24d6-4f91-adde-8086689cf630): created successfully Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4076630-4666-492a-9132-3238a9019f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (05fcdb13-10a4-42eb-917d-3005e7cd0f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-955b22e0-90c3-4597-b1b3-c541585555b0" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-790b63a0-c1b7-4cda-9f17-4f745c7520c5 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created volume successfully. Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-955b22e0-90c3-4597-b1b3-c541585555b0" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Created reservations ['f4fa7897-d678-4229-8f35-e9885a33076c', '1f02d4aa-1107-4b2b-aeae-81518cdad3ee', '42817dec-b95f-4c15-b7b9-1480e3ad98dd', 'f57fc3aa-1961-4722-b54c-25a985291944'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c97410-d362-4b4a-81a7-98220ce40056]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:46 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 Sep 07 16:54:46 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:46 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:46 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:47 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 1073741824" returned: 0 in 0.550s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:47 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.372s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:47 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 Sep 07 16:54:47 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:47 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Deleted volume successfully. Sep 07 16:54:47 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0" returned: 0 in 0.528s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-fb030e6f-d454-420d-82b3-3e2d4a6b77cb tempest-ProjectReaderTests-258644507 None] Lock "cinder-a8baf50c-6789-4877-b2d9-b72000f4d734-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:47 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0 Sep 07 16:54:47 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:47 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84" returned: 0 in 0.378s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038913478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:46Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Creating volume 37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:47 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:47 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e 1073741824 Sep 07 16:54:47 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (208f12f7-c622-485a-a7c6-a5552d8fee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39e8f18-3053-4829-b627-5d4b4d7f2046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:47 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 (7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84): created successfully Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39e8f18-3053-4829-b627-5d4b4d7f2046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (de1157ad-a158-4a34-ad15-ecc491038b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:47 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-84f2940d-714b-44ff-bd42-ea24fc71a612 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created volume successfully. Sep 07 16:54:47 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-955b22e0-90c3-4597-b1b3-c541585555b0" returned: 0 in 0.448s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-955b22e0-90c3-4597-b1b3-c541585555b0" released by "delete_volume" :: held 1.054s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['32d50031-52ca-40a7-8e3e-c8ce49614889', 'aaa5a629-cf27-4b20-af4a-b7724094b632', '2d3b939d-c3ab-4822-a877-44994112cc84', '71d2d0ae-1c7c-4e17-a1fc-c45443038b65'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:47 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:47 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:48 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Flow 'volume_create_manager' (2c5db29e-c22c-4f52-89cb-beb49c44c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a80147-c686-4a61-bb54-97fc86b19b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e 1073741824" returned: 0 in 0.605s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a80147-c686-4a61-bb54-97fc86b19b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1229569282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82cba7-c0a6-45a1-bcd9-17e6a507167e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb9503f17c34c2287cae8812e9259ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:48Z,use_quota=True,user_id='887688227218486e917ecbb568e7bc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d989be2d-ed4f-4ff1-a0c9-f2bd4eeb1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d989be2d-ed4f-4ff1-a0c9-f2bd4eeb1185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fb4398-1acc-4fa1-b38f-2137b88bb9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fb4398-1acc-4fa1-b38f-2137b88bb9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea82cba7-c0a6-45a1-bcd9-17e6a507167e', 'volume_name': 'volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e820dc8d-094f-4bc8-8ccd-fc08e7ca7933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e820dc8d-094f-4bc8-8ccd-fc08e7ca7933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d22c66a-e0b8-4453-96e2-09d83b1f4ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Volume ea82cba7-c0a6-45a1-bcd9-17e6a507167e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e', 'volume_size': 1} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.324s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Deleted volume successfully. Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (971f6339-4cbc-45f9-9752-c4c6ae102e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd870bdd-1f74-43af-8817-cc67b1e9c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd870bdd-1f74-43af-8817-cc67b1e9c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227023522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c608434-ff15-4953-ae0d-d798f518829a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:48Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbb187d-64f6-4d4f-8c02-ad852c01c1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbb187d-64f6-4d4f-8c02-ad852c01c1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1361610a-0e89-4808-bd9c-4272382cc51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1361610a-0e89-4808-bd9c-4272382cc51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c608434-ff15-4953-ae0d-d798f518829a', 'volume_name': 'volume-9c608434-ff15-4953-ae0d-d798f518829a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915cc25d-578f-49a1-95bd-53bc695cbd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915cc25d-578f-49a1-95bd-53bc695cbd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c693b102-0f2b-4dd9-86e1-a16b8aa466d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Volume 9c608434-ff15-4953-ae0d-d798f518829a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c608434-ff15-4953-ae0d-d798f518829a', 'volume_size': 1} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-06b38a95-8363-4256-abb4-493bd8144b8f tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-955b22e0-90c3-4597-b1b3-c541585555b0-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:48 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e Sep 07 16:54:48 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:48 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e" returned: 0 in 0.297s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685682862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56391054-7104-42ae-b1b4-08f9f1cd5140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f037e60eb5f6477cad867608d01f9da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:46Z,use_quota=True,user_id='84c8383cb25648f7ac5d9ad50fdb021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Creating volume 56391054-7104-42ae-b1b4-08f9f1cd5140 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:48 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:48 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 1073741824 Sep 07 16:54:48 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c97b47d-b0dc-43ac-af01-af91fe031374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917f4a8b-0086-4526-8852-5af56fdc0527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:48 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e (37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e): created successfully Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917f4a8b-0086-4526-8852-5af56fdc0527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (e7f44778-9497-4ec8-a607-c1d41d98c620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-bf5a602f-8070-4609-b907-fe99d5946a0a tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created volume successfully. Sep 07 16:54:49 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 1073741824" returned: 0 in 0.471s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:49 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 Sep 07 16:54:49 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (b5718007-5db2-46b4-b767-9d0d1b86fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dab85e6-a731-4089-bf89-99fdeed5b0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:49 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1229569282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea82cba7-c0a6-45a1-bcd9-17e6a507167e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb9503f17c34c2287cae8812e9259ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:48Z,use_quota=True,user_id='887688227218486e917ecbb568e7bc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Creating volume ea82cba7-c0a6-45a1-bcd9-17e6a507167e {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:49 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dab85e6-a731-4089-bf89-99fdeed5b0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952894653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1f815f-d23a-4aaf-85d7-38f178ed9079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:49Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:49 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e 1073741824 Sep 07 16:54:49 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b02cfc-afa5-4493-b82d-09a8012fae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b02cfc-afa5-4493-b82d-09a8012fae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7f954a-ab43-45df-9821-3779dcd80064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7f954a-ab43-45df-9821-3779dcd80064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f1f815f-d23a-4aaf-85d7-38f178ed9079', 'volume_name': 'volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a69164-7014-47f0-b6d2-75efebf21019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a69164-7014-47f0-b6d2-75efebf21019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17124454-872a-4ebe-a497-40004cd99bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:49 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Volume 0f1f815f-d23a-4aaf-85d7-38f178ed9079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079', 'volume_size': 1} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b6c26b-d858-48a3-a8e6-866e9f5806ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56391054-7104-42ae-b1b4-08f9f1cd5140', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad5d19-ea36-4f0e-b8c2-ce84f9ecda1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:49 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Volume volume-56391054-7104-42ae-b1b4-08f9f1cd5140 (56391054-7104-42ae-b1b4-08f9f1cd5140): created successfully Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad5d19-ea36-4f0e-b8c2-ce84f9ecda1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Flow 'volume_create_manager' (42800f69-888a-4007-82f3-78aca4d3a631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:49 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f51892fe-b9d0-4627-a5e1-0c028d298a68 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created volume successfully. Sep 07 16:54:49 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e 1073741824" returned: 0 in 0.389s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:49 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e Sep 07 16:54:49 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-56391054-7104-42ae-b1b4-08f9f1cd5140-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-56391054-7104-42ae-b1b4-08f9f1cd5140-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-56391054-7104-42ae-b1b4-08f9f1cd5140" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-56391054-7104-42ae-b1b4-08f9f1cd5140" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda3ed3b-a636-4815-885a-d2bdba8e72f7]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:50 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e" returned: 0 in 0.308s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.842s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227023522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c608434-ff15-4953-ae0d-d798f518829a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214e0aceaf9940b1be0c3795f7fb97a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:48Z,use_quota=True,user_id='58094dc651cd461bbde37dbdea3eddab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Creating volume 9c608434-ff15-4953-ae0d-d798f518829a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:50 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d22c66a-e0b8-4453-96e2-09d83b1f4ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:50 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a 1073741824 Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8398efd-0291-4346-a19d-6bc92f8fb00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:50 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Volume volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e (ea82cba7-c0a6-45a1-bcd9-17e6a507167e): created successfully Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8398efd-0291-4346-a19d-6bc92f8fb00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Flow 'volume_create_manager' (2c5db29e-c22c-4f52-89cb-beb49c44c259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-64165181-367a-4479-8d26-2be18a2267f7 tempest-VolumesTransfersV355Test-1938373536 None] Created volume successfully. Sep 07 16:54:50 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 Sep 07 16:54:50 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:50 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140" returned: 0 in 0.365s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:50 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140 Sep 07 16:54:50 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:50 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a 1073741824" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:50 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a Sep 07 16:54:50 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:50 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-56391054-7104-42ae-b1b4-08f9f1cd5140" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-56391054-7104-42ae-b1b4-08f9f1cd5140" released by "delete_volume" :: held 0.649s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created reservations ['905813d3-fe31-4203-999a-a5cb499a2a3e', '7e0390a6-0288-4cbe-ae78-c1e62c988fa9', '7d8fed4d-305a-4077-bdb4-ec40ceb0c887', '32ace413-84bc-4d87-a972-007128b24eaa'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:50 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.429s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-952894653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1f815f-d23a-4aaf-85d7-38f178ed9079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:49Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Creating volume 0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:50 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:50 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:50 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c693b102-0f2b-4dd9-86e1-a16b8aa466d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c608434-ff15-4953-ae0d-d798f518829a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fab7b1-3556-4352-8582-0d2efb1e419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:50 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 1073741824 Sep 07 16:54:50 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Volume volume-9c608434-ff15-4953-ae0d-d798f518829a (9c608434-ff15-4953-ae0d-d798f518829a): created successfully Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fab7b1-3556-4352-8582-0d2efb1e419e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Flow 'volume_create_manager' (971f6339-4cbc-45f9-9752-c4c6ae102e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f6abe6cd-4753-48c6-bbeb-2d49ba1a9d78 tempest-ProjectReaderTests-258644507 None] Created volume successfully. Sep 07 16:54:51 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.276s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Deleted volume successfully. Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e155a707-7c66-47b0-942a-f2ec7495ac54 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-56391054-7104-42ae-b1b4-08f9f1cd5140-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-9c608434-ff15-4953-ae0d-d798f518829a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Lock "cinder-9c608434-ff15-4953-ae0d-d798f518829a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Acquiring lock "cinder-quobyte-9c608434-ff15-4953-ae0d-d798f518829a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-9c608434-ff15-4953-ae0d-d798f518829a" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3576b2-1e60-4a8e-93df-c922301004c3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7862f084-0733-42cc-bba1-c56428e22cdd]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:51 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 1073741824" returned: 0 in 0.623s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:51 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a Sep 07 16:54:51 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:51 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 Sep 07 16:54:51 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:51 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e Sep 07 16:54:51 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:51 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a" returned: 0 in 0.427s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:51 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a Sep 07 16:54:51 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:51 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079" returned: 0 in 0.306s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17124454-872a-4ebe-a497-40004cd99bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe16bfd9-3c3f-47c1-b369-27bad6525ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:51 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Volume volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 (0f1f815f-d23a-4aaf-85d7-38f178ed9079): created successfully Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe16bfd9-3c3f-47c1-b369-27bad6525ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (b5718007-5db2-46b4-b767-9d0d1b86fc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f797abf7-f866-4d34-b2ca-5360fd761f47 tempest-VolumesSnapshotTestJSON-1708725501 None] Created volume successfully. Sep 07 16:54:51 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e" returned: 0 in 0.471s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:52 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e Sep 07 16:54:52 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-61c06003-d463-406c-a56a-ec0e0f35c402 tempest-VolumesTransfersV355Test-1786949602 None] Transfer volume completed successfully. Sep 07 16:54:52 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9c608434-ff15-4953-ae0d-d798f518829a" returned: 0 in 0.312s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Lock "cinder-quobyte-9c608434-ff15-4953-ae0d-d798f518829a" released by "delete_volume" :: held 0.825s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Created reservations ['c476de46-cc0d-4bdd-9724-1540348f3701', '74568768-a82a-436c-a6eb-b8fe0ed834c2', 'c95c7544-7ad4-4098-af6c-63d8fe3f940d', 'b5bd699e-9cbb-4a64-b336-9032f673f160'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:52 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e" returned: 0 in 0.315s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:52 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:52 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e" released by "delete_volume" :: held 0.842s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created reservations ['2273d968-f1cb-44ed-9772-bbe880ec5788', '4adeb9bd-0fda-4186-8683-6a37cabb08ed', '98742391-d54b-4dba-a223-8388ad68f01d', 'e7d050f2-7dce-4af0-8326-2a4115a5c0fa'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:52 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.370s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:52 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:52 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Deleted volume successfully. Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a4458c97-8f0e-485d-861e-088d9ad3c6bb tempest-ProjectReaderTests-258644507 None] Lock "cinder-9c608434-ff15-4953-ae0d-d798f518829a-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Creating offline snapshot 04ccb725-a4f7-4060-9c2d-47a5140f268a of volume 0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Acquiring lock "cinder-ea82cba7-c0a6-45a1-bcd9-17e6a507167e-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53bbf51-cdf1-49c6-b7fd-5439d52a9b2f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-ea82cba7-c0a6-45a1-bcd9-17e6a507167e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Acquiring lock "cinder-quobyte-ea82cba7-c0a6-45a1-bcd9-17e6a507167e" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-quobyte-ea82cba7-c0a6-45a1-bcd9-17e6a507167e" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:53 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Deleted volume successfully. Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2deae1-e861-4f18-83dd-507881c770f3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e94c96e5-5826-425d-8f7e-b1d7cd9ae9cf tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-37dad6e5-2a99-483f-ae7c-bf7e82ce1b8e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:53 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 Sep 07 16:54:53 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:53 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e Sep 07 16:54:53 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:53 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079" returned: 0 in 0.453s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:53 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a 1G Sep 07 16:54:53 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:53 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e" returned: 0 in 0.391s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:53 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e Sep 07 16:54:53 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:53 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ea82cba7-c0a6-45a1-bcd9-17e6a507167e" returned: 0 in 0.286s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-quobyte-ea82cba7-c0a6-45a1-bcd9-17e6a507167e" released by "delete_volume" :: held 0.747s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Created reservations ['daf29458-de88-44ff-9dd1-5f2382c1af9d', 'eaca4940-3ba7-416f-8c42-ec83c593b506', '377eb18b-7e6b-4c89-a34f-8861a9ac4781', 'd3c3232d-f0df-44c5-b4f3-98a7e42fbc5e'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a540a0a-9dfc-4bf2-9434-58fd876f7813]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:53 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a 1G" returned: 0 in 0.539s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:53 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a Sep 07 16:54:53 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:54 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:54 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:54 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 Sep 07 16:54:54 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:54 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a" returned: 0 in 0.374s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:54 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a is being set with open permissions: ugo+rw Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:54 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a Sep 07 16:54:54 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:54 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.394s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:54 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Deleted volume successfully. Sep 07 16:54:54 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84" returned: 0 in 0.535s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bb25b915-0d11-444e-b057-f67e79d603fb tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-ea82cba7-c0a6-45a1-bcd9-17e6a507167e-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:54 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84 Sep 07 16:54:54 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:54 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a" returned: 0 in 0.368s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:54 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.info Sep 07 16:54:54 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:54 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84" returned: 0 in 0.324s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84" released by "delete_volume" :: held 0.919s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Flow 'volume_create_manager' (558ea5ba-7291-4878-a6f2-eae88fac7287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e169e31-f216-4484-8325-4a24a750d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e169e31-f216-4484-8325-4a24a750d4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-802458431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79210280-b7c4-42a5-aa2a-876e105d1e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb9503f17c34c2287cae8812e9259ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:55Z,use_quota=True,user_id='887688227218486e917ecbb568e7bc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5addbde-04eb-4dbf-ba84-d36ac1663cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5addbde-04eb-4dbf-ba84-d36ac1663cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314bc202-b5e8-4b39-a672-93c975557f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314bc202-b5e8-4b39-a672-93c975557f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79210280-b7c4-42a5-aa2a-876e105d1e2e', 'volume_name': 'volume-79210280-b7c4-42a5-aa2a-876e105d1e2e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78e1868-d61b-4c2a-bb86-15f048fbeaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78e1868-d61b-4c2a-bb86-15f048fbeaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6657d28-605d-4cbf-bbae-bfea8d2927f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:54 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Volume 79210280-b7c4-42a5-aa2a-876e105d1e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79210280-b7c4-42a5-aa2a-876e105d1e2e', 'volume_size': 1} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:54 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created reservations ['9158e959-9df2-4d4c-8817-f8261a7a5ef7', '444e0257-a0eb-44c1-a13b-5693bc0af21f', '9c13d1c4-7349-4b7d-b36b-f43a183abddc', '4c126db2-0890-4319-b930-244b7559aeed'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:55 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.info" returned: 0 in 0.322s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:55 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.info is being set with open permissions: ugo+rw Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:55 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.info Sep 07 16:54:55 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:55 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:55 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:55 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.info" returned: 0 in 0.266s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:55 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-802458431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79210280-b7c4-42a5-aa2a-876e105d1e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeb9503f17c34c2287cae8812e9259ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:55Z,use_quota=True,user_id='887688227218486e917ecbb568e7bc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Creating volume 79210280-b7c4-42a5-aa2a-876e105d1e2e {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:55 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.284s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Deleted volume successfully. Sep 07 16:54:55 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e 1073741824 Sep 07 16:54:55 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0d8913c0-4d08-480e-be29-e9db3cc04899 tempest-VolumesSnapshotTestJSON-1708725501 None] Create snapshot completed successfully Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3d548f2a-6f1d-4edd-8cf8-30ed9289dc01 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-7897d7b0-e4ab-4dd7-beb9-c1230f4dbb84-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:55 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e 1073741824" returned: 0 in 0.412s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:55 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e Sep 07 16:54:55 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-81e0c384-24d6-4f91-adde-8086689cf630-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-81e0c384-24d6-4f91-adde-8086689cf630-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:56 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e" returned: 0 in 0.289s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-81e0c384-24d6-4f91-adde-8086689cf630" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6657d28-605d-4cbf-bbae-bfea8d2927f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79210280-b7c4-42a5-aa2a-876e105d1e2e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1961a65e-6e59-44d3-b8e3-f78ec83cf728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-81e0c384-24d6-4f91-adde-8086689cf630" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:56 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Volume volume-79210280-b7c4-42a5-aa2a-876e105d1e2e (79210280-b7c4-42a5-aa2a-876e105d1e2e): created successfully Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1961a65e-6e59-44d3-b8e3-f78ec83cf728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Flow 'volume_create_manager' (558ea5ba-7291-4878-a6f2-eae88fac7287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cc58a9-09dd-4d10-b8ae-b2975b2d724b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:56 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4b3c2c0a-eb81-4481-9c3e-548f468ba111 tempest-VolumesTransfersV355Test-1938373536 None] Created volume successfully. Sep 07 16:54:56 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 Sep 07 16:54:56 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:56 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630" returned: 0 in 0.402s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:56 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630 Sep 07 16:54:56 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (6f369418-26c7-4a09-bb81-8a9d3723a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97c1ebb-037b-4331-b07a-df2fb19c73aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97c1ebb-037b-4331-b07a-df2fb19c73aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1024738549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8106fee0-9c1e-4836-8f8e-c14752e6e15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9c168dd8f2843f2aa99e1783ab9e961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=04ccb725-a4f7-4060-9c2d-47a5140f268a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:54:57Z,use_quota=True,user_id='6346d5b56d3f49d8804f2d161a923bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91d7d16-5557-4a76-adaf-cf8e288f3a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91d7d16-5557-4a76-adaf-cf8e288f3a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2703953-a0f9-4a97-90da-fa03e5860b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2703953-a0f9-4a97-90da-fa03e5860b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8106fee0-9c1e-4836-8f8e-c14752e6e15e', 'volume_name': 'volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e', 'volume_size': 1, 'snapshot_id': '04ccb725-a4f7-4060-9c2d-47a5140f268a'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5652d09d-54d7-4066-a2d8-23d2632f8777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5652d09d-54d7-4066-a2d8-23d2632f8777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cab112-5f74-4d18-9834-8a26080a9852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:54:56 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Volume 8106fee0-9c1e-4836-8f8e-c14752e6e15e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e', 'volume_size': 1, 'snapshot_id': '04ccb725-a4f7-4060-9c2d-47a5140f268a'} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-04ccb725-a4f7-4060-9c2d-47a5140f268a-8106fee0-9c1e-4836-8f8e-c14752e6e15e" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-04ccb725-a4f7-4060-9c2d-47a5140f268a-8106fee0-9c1e-4836-8f8e-c14752e6e15e" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Creating volume 8106fee0-9c1e-4836-8f8e-c14752e6e15e from snapshot 04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-8106fee0-9c1e-4836-8f8e-c14752e6e15e" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-8106fee0-9c1e-4836-8f8e-c14752e6e15e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] snapshot: 04ccb725-a4f7-4060-9c2d-47a5140f268a, volume: 8106fee0-9c1e-4836-8f8e-c14752e6e15e, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:54:56 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-81e0c384-24d6-4f91-adde-8086689cf630" returned: 0 in 0.286s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[18095b32-1481-405d-80ad-7f468fd6281e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-81e0c384-24d6-4f91-adde-8086689cf630" released by "delete_volume" :: held 0.745s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:56 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created reservations ['92762aab-b873-4280-a8b4-3e607d2a9113', 'c7bf052d-67bf-4b8d-8959-e4a58cd3335b', '3df93cda-57c1-459e-8b9d-d0f47c0f7898', '7f42168f-89d0-492e-a830-0214397a752b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:56 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a Sep 07 16:54:56 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:57 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:57 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Acquiring lock "cinder-79210280-b7c4-42a5-aa2a-876e105d1e2e-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-79210280-b7c4-42a5-aa2a-876e105d1e2e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:57 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:57 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a" returned: 0 in 0.548s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.375s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e3380-3f81-4a25-b556-b6ff49f96a5f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e233e4-66ab-4fa7-bae0-5884507cd1d2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Acquiring lock "cinder-quobyte-79210280-b7c4-42a5-aa2a-876e105d1e2e" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Deleted volume successfully. Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-quobyte-79210280-b7c4-42a5-aa2a-876e105d1e2e" acquired by "delete_volume" :: waited 0.039s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ebb07e18-34ea-4b7f-8663-c286fd2c5cb3 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-81e0c384-24d6-4f91-adde-8086689cf630-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3907dbe7-ceb3-48a6-a81a-477ef3f067d4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:57 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f Sep 07 16:54:57 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:57 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 Sep 07 16:54:57 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:57 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e Sep 07 16:54:57 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:57 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f" returned: 0 in 0.404s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:57 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079" returned: 0 in 0.410s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:57 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f Sep 07 16:54:57 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:57 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e Sep 07 16:54:57 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:57 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e" returned: 0 in 0.400s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:57 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e Sep 07 16:54:57 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:58 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f" returned: 0 in 0.270s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f" released by "delete_volume" :: held 0.720s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created reservations ['75f9bc85-fdeb-4ec1-af5a-3245aae94548', 'a8b3317d-124b-4a73-b323-56bca2c6bbdc', '21ce44f4-84c6-4c52-8875-45882b1d6191', '56c6da62-4ae4-459c-94a9-cb430906f168'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:58 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-79210280-b7c4-42a5-aa2a-876e105d1e2e" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-quobyte-79210280-b7c4-42a5-aa2a-876e105d1e2e" released by "delete_volume" :: held 0.723s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:58 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:58 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Created reservations ['ab8e6369-db35-449f-af81-651ec21f20cc', 'b631889e-ff64-4c9c-a14d-a95ebd65921a', '42d67463-8332-47e1-9721-0ab3e868ba0e', 'bdcf5935-b318-4847-aaa7-7e0ca3ffd33d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-141c27bf-fc16-4a68-9c75-bfebf3d0e776-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:58 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:54:58 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-141c27bf-fc16-4a68-9c75-bfebf3d0e776-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-68c2a6ac-f41b-447b-935c-f5abd7b72a09" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-68c2a6ac-f41b-447b-935c-f5abd7b72a09" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-141c27bf-fc16-4a68-9c75-bfebf3d0e776" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-141c27bf-fc16-4a68-9c75-bfebf3d0e776" acquired by "_delete_snapshot" :: waited 0.088s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:54:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Deleting offline snapshot 141c27bf-fc16-4a68-9c75-bfebf3d0e776 of volume 68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] snapshot_file for this snap is: volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[899f4882-edbd-429a-985e-68051519b3c6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:59 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 1.013s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:59 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Deleted volume successfully. Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-145bcb67-90d2-43df-ad63-534153649d4b tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-dfdfd6e9-15e3-4b55-b54f-daf19c81a45f-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:54:59 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 Sep 07 16:54:59 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:59 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 1.127s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:59 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Deleted volume successfully. Sep 07 16:54:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-02624bca-55d5-484b-a5b2-b5c44e1e7236 tempest-VolumesTransfersV355Test-760433389 None] Lock "cinder-79210280-b7c4-42a5-aa2a-876e105d1e2e-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:00 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776" returned: 0 in 1.382s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a24990-6915-49d0-aeed-c0c24e2dd292]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:00 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 Sep 07 16:55:00 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:02 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09" returned: 0 in 1.550s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:02 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 Sep 07 16:55:02 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:02 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776" returned: 0 in 0.896s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:03 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776 Sep 07 16:55:03 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:03 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09.141c27bf-fc16-4a68-9c75-bfebf3d0e776" returned: 0 in 0.798s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-141c27bf-fc16-4a68-9c75-bfebf3d0e776" released by "_delete_snapshot" :: held 4.883s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-68c2a6ac-f41b-447b-935c-f5abd7b72a09" released by "delete_snapshot" :: held 4.979s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:03 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e" returned: 0 in 6.002s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:55:03 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Converted 1024.00 MB image at 170.57 MB/s Sep 07 16:55:03 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e is being set with open permissions: ugo+rw Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:03 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e Sep 07 16:55:03 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created reservations ['fae541df-d094-4381-a098-0610653c8992', '8dda8aa7-419a-4b19-b165-bf56d7ceb148', 'c2726f78-5dda-4f93-87ac-1e6f040a74cd', '1e02835a-8dc1-42ee-9014-a5ce4a61d2ce'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Delete snapshot completed successfully. Sep 07 16:55:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9ca5f679-ea94-4457-bae6-839a9df750bb tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-141c27bf-fc16-4a68-9c75-bfebf3d0e776-delete_snapshot" released by "delete_snapshot" :: held 5.234s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:04 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e" returned: 0 in 0.330s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-8106fee0-9c1e-4836-8f8e-c14752e6e15e" released by "_copy_volume_from_snapshot" :: held 7.392s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-04ccb725-a4f7-4060-9c2d-47a5140f268a-8106fee0-9c1e-4836-8f8e-c14752e6e15e" released by "_create_volume_from_snapshot" :: held 7.460s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.481s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cab112-5f74-4d18-9834-8a26080a9852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e', 'volume_size': 1, 'snapshot_id': '04ccb725-a4f7-4060-9c2d-47a5140f268a'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef33bb94-5fe2-49ee-ab18-90508b7f2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Volume volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e (8106fee0-9c1e-4836-8f8e-c14752e6e15e): created successfully Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef33bb94-5fe2-49ee-ab18-90508b7f2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Flow 'volume_create_manager' (6f369418-26c7-4a09-bb81-8a9d3723a252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-df8aa3c1-7f22-4706-9608-fba23e1a583b tempest-VolumesSnapshotTestJSON-1708725501 None] Created volume successfully. Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-68c2a6ac-f41b-447b-935c-f5abd7b72a09-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-68c2a6ac-f41b-447b-935c-f5abd7b72a09-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "cinder-quobyte-68c2a6ac-f41b-447b-935c-f5abd7b72a09" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-68c2a6ac-f41b-447b-935c-f5abd7b72a09" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aea7be-e7d1-4a21-a5db-65f65ef4e230]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:04 devstack sudo[102962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 Sep 07 16:55:04 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:04 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09" returned: 0 in 0.388s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:04 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09 Sep 07 16:55:04 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-8106fee0-9c1e-4836-8f8e-c14752e6e15e-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-8106fee0-9c1e-4836-8f8e-c14752e6e15e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-8106fee0-9c1e-4836-8f8e-c14752e6e15e" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-8106fee0-9c1e-4836-8f8e-c14752e6e15e" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dc0335-98e8-4628-b10a-d2159ae42b6e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:05 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-68c2a6ac-f41b-447b-935c-f5abd7b72a09" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-quobyte-68c2a6ac-f41b-447b-935c-f5abd7b72a09" released by "delete_volume" :: held 0.762s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:05 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e Sep 07 16:55:05 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Created reservations ['f11a1840-5b9d-471a-bba2-db796bf6709e', 'b7674691-189f-438a-833c-8abcf06c2824', 'c49fa9cb-b4e7-4fab-a45c-677ae6682ddd', '3eb4bf50-c38c-4dea-90ea-b607caf9006c'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:05 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:05 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:05 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e" returned: 0 in 0.411s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:05 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e Sep 07 16:55:05 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:05 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.321s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Deleted volume successfully. Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5143cc6a-77d4-4118-9358-e98cc0ba4c40 tempest-CreateVolumesFromSnapshotTest-1211386405 None] Lock "cinder-68c2a6ac-f41b-447b-935c-f5abd7b72a09-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:05 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8106fee0-9c1e-4836-8f8e-c14752e6e15e" returned: 0 in 0.344s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-8106fee0-9c1e-4836-8f8e-c14752e6e15e" released by "delete_volume" :: held 0.802s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['9ff5b982-bb95-46ee-b134-3d0e2932e0a4', '7b48e679-d948-490f-87f7-6605256ae309', 'd672d2d1-0a19-42c3-b79f-9fe479bb066d', 'cf1063ee-ed0d-46cc-a687-d7919e70f744'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:06 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:06 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-04ccb725-a4f7-4060-9c2d-47a5140f268a-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-04ccb725-a4f7-4060-9c2d-47a5140f268a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-0f1f815f-d23a-4aaf-85d7-38f178ed9079" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-0f1f815f-d23a-4aaf-85d7-38f178ed9079" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-04ccb725-a4f7-4060-9c2d-47a5140f268a" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-04ccb725-a4f7-4060-9c2d-47a5140f268a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Deleting offline snapshot 04ccb725-a4f7-4060-9c2d-47a5140f268a of volume 0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] snapshot_file for this snap is: volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:55:06 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5785385e-dbe1-4960-941d-e7afd1fd8d90]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.397s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Deleted volume successfully. Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-aef58fd6-969f-4663-8995-d63779660d43 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-8106fee0-9c1e-4836-8f8e-c14752e6e15e-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:06 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a Sep 07 16:55:06 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:06 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a" returned: 0 in 0.438s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c17439-2a01-4634-963c-8d5bdf8b0a48]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:07 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 Sep 07 16:55:07 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:07 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079" returned: 0 in 0.598s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:07 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a Sep 07 16:55:07 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:07 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a" returned: 0 in 0.394s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:07 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a Sep 07 16:55:07 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:08 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079.04ccb725-a4f7-4060-9c2d-47a5140f268a" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-04ccb725-a4f7-4060-9c2d-47a5140f268a" released by "_delete_snapshot" :: held 1.872s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-0f1f815f-d23a-4aaf-85d7-38f178ed9079" released by "delete_snapshot" :: held 1.909s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['b248b374-a708-46eb-89e0-172732b3670c', 'd4296dfa-3169-4be6-8e78-cfe691fc0253', '387d8f9c-4464-40bc-9824-2fcf1492d420', 'dcf14e65-3a39-4b05-9e61-e5cca1b4ba64'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:08 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Delete snapshot completed successfully. Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9c0deb18-ed4a-451a-bccf-d15159bd96f7 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-04ccb725-a4f7-4060-9c2d-47a5140f268a-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-0f1f815f-d23a-4aaf-85d7-38f178ed9079-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-0f1f815f-d23a-4aaf-85d7-38f178ed9079-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-0f1f815f-d23a-4aaf-85d7-38f178ed9079" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-0f1f815f-d23a-4aaf-85d7-38f178ed9079" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dd233f-2cf5-430b-a34a-f05e8aa4aaf9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:08 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 Sep 07 16:55:08 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:09 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079" returned: 0 in 0.411s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:09 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079 Sep 07 16:55:09 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:09 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0f1f815f-d23a-4aaf-85d7-38f178ed9079" returned: 0 in 0.299s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-0f1f815f-d23a-4aaf-85d7-38f178ed9079" released by "delete_volume" :: held 0.782s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Flow 'volume_create_manager' (40fee9bb-431e-4667-8b7d-0054b071366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5e6444-2711-4ab3-96b7-a15210003c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa5e6444-2711-4ab3-96b7-a15210003c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1d5d3c-2ef8-4042-8428-affbea149886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fafd1e901e4c3087044798d3b49bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:09Z,use_quota=True,user_id='86f61e3499c14121a7cd0cb8390887f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00520e7c-8b5c-41ea-baae-3f59dbb01210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00520e7c-8b5c-41ea-baae-3f59dbb01210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b54b1f-cc20-42eb-a5a6-d8a414ebdbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b54b1f-cc20-42eb-a5a6-d8a414ebdbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1d5d3c-2ef8-4042-8428-affbea149886', 'volume_name': 'volume-2e1d5d3c-2ef8-4042-8428-affbea149886', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f61585-728b-4315-8b40-88145be676ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f61585-728b-4315-8b40-88145be676ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68d0072-3ddd-4a86-afaf-1299c4e6fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:09 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Volume 2e1d5d3c-2ef8-4042-8428-affbea149886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1d5d3c-2ef8-4042-8428-affbea149886', 'volume_size': 1} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1d5d3c-2ef8-4042-8428-affbea149886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fafd1e901e4c3087044798d3b49bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:09Z,use_quota=True,user_id='86f61e3499c14121a7cd0cb8390887f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Creating volume 2e1d5d3c-2ef8-4042-8428-affbea149886 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:09 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:09 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 1073741824 Sep 07 16:55:09 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['c5038155-10ec-4f2d-b172-3647fa7acd1c', '161b2ab5-6b8c-44ee-822e-eeaa20d8309f', '420bf5fc-3226-40fa-a314-69d2f133e447', 'bac17a29-872b-44be-8c0e-0782d550c1c7'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:09 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:09 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-c97e6888-d03a-4b17-a85d-912aa74a03e0-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-c97e6888-d03a-4b17-a85d-912aa74a03e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "cinder-quobyte-c97e6888-d03a-4b17-a85d-912aa74a03e0" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-c97e6888-d03a-4b17-a85d-912aa74a03e0" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:10 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae1d22-30da-4290-a310-a0d9fd87b59c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.317s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Deleted volume successfully. Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2d32f882-ec7a-43d1-8773-d29aecbc0e17 tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-0f1f815f-d23a-4aaf-85d7-38f178ed9079-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:10 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 1073741824" returned: 0 in 0.614s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:10 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 Sep 07 16:55:10 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:10 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 Sep 07 16:55:10 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:10 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0" returned: 0 in 0.472s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:10 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886" returned: 0 in 0.309s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:10 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0 Sep 07 16:55:10 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68d0072-3ddd-4a86-afaf-1299c4e6fb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1d5d3c-2ef8-4042-8428-affbea149886', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be5b271-396d-4e3d-8520-f3002f1f127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:10 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Volume volume-2e1d5d3c-2ef8-4042-8428-affbea149886 (2e1d5d3c-2ef8-4042-8428-affbea149886): created successfully Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be5b271-396d-4e3d-8520-f3002f1f127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Flow 'volume_create_manager' (40fee9bb-431e-4667-8b7d-0054b071366e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a31ea5ad-2a78-49ba-9a53-44ff764c0c76 tempest-CinderUnicodeTest-396305125 None] Created volume successfully. Sep 07 16:55:10 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c97e6888-d03a-4b17-a85d-912aa74a03e0" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-quobyte-c97e6888-d03a-4b17-a85d-912aa74a03e0" released by "delete_volume" :: held 0.830s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Created reservations ['2d6743a4-6e80-41bf-99c0-27cdcabe6b93', '068b7ca2-af05-41ad-8fbc-85f01b8ea798', '3e17e2b7-4150-47f3-8537-2b93a17d7ce9', '1e914ac6-13ed-4019-af7a-b8ee5997b205'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:10 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:10 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:11 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.261s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:11 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Deleted volume successfully. Sep 07 16:55:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-446f65be-b614-4707-b5da-7dac94b0095c tempest-VolumesSnapshotTestJSON-1708725501 None] Lock "cinder-c97e6888-d03a-4b17-a85d-912aa74a03e0-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Flow 'volume_create_manager' (50227525-b9e5-42d5-aa15-b1d18616d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5731a4f3-2b1a-461c-987e-db07c672b632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5731a4f3-2b1a-461c-987e-db07c672b632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1109738593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7954531d-6949-4606-b5b4-f3ea9567cd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fafd1e901e4c3087044798d3b49bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:12Z,use_quota=True,user_id='86f61e3499c14121a7cd0cb8390887f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690ed96f-08cf-4e0d-8b3c-4322a89426f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690ed96f-08cf-4e0d-8b3c-4322a89426f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4029ff5-dc34-4a02-9b78-d6c4536b7e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4029ff5-dc34-4a02-9b78-d6c4536b7e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7954531d-6949-4606-b5b4-f3ea9567cd60', 'volume_name': 'volume-7954531d-6949-4606-b5b4-f3ea9567cd60', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7effc6-10d2-4ec9-8b5e-2af13559f38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7effc6-10d2-4ec9-8b5e-2af13559f38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36595c6-423f-4fac-88db-32359ff95018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:12 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Volume 7954531d-6949-4606-b5b4-f3ea9567cd60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7954531d-6949-4606-b5b4-f3ea9567cd60', 'volume_size': 1} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1109738593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7954531d-6949-4606-b5b4-f3ea9567cd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fafd1e901e4c3087044798d3b49bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:12Z,use_quota=True,user_id='86f61e3499c14121a7cd0cb8390887f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Creating volume 7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:12 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:12 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 1073741824 Sep 07 16:55:12 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:12 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 1073741824" returned: 0 in 0.563s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:12 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 Sep 07 16:55:12 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:13 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60" returned: 0 in 0.311s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36595c6-423f-4fac-88db-32359ff95018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7954531d-6949-4606-b5b4-f3ea9567cd60', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e01cb5-2077-44a1-a81f-8be3e6ba92fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Volume volume-7954531d-6949-4606-b5b4-f3ea9567cd60 (7954531d-6949-4606-b5b4-f3ea9567cd60): created successfully Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e01cb5-2077-44a1-a81f-8be3e6ba92fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Flow 'volume_create_manager' (50227525-b9e5-42d5-aa15-b1d18616d030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9935a7bc-85a8-4d25-8d4c-930146e156c1 tempest-CinderUnicodeTest-396305125 None] Created volume successfully. Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Flow 'volume_create_manager' (ee093236-d802-4246-a435-448b80eb40fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6067dafe-b749-4480-ad86-78708e0c355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6067dafe-b749-4480-ad86-78708e0c355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-284936129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d758393-e2ba-445a-8873-d8dd2a5def4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09226b66c6a04ef9a7809a585e095998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:14Z,use_quota=True,user_id='736e640d74874c89bad3b760182406a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b30c886-c6cd-41a6-ab2c-62ad37ea694a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b30c886-c6cd-41a6-ab2c-62ad37ea694a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a19d3b-ba40-499c-a2ca-5c9f9db422f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a19d3b-ba40-499c-a2ca-5c9f9db422f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d758393-e2ba-445a-8873-d8dd2a5def4e', 'volume_name': 'volume-3d758393-e2ba-445a-8873-d8dd2a5def4e', 'volume_size': 2}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5963fe1a-dbea-4681-9d7c-0f49968bbdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5963fe1a-dbea-4681-9d7c-0f49968bbdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7479965-42dd-460e-8069-48dbd7f66960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Volume 3d758393-e2ba-445a-8873-d8dd2a5def4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d758393-e2ba-445a-8873-d8dd2a5def4e', 'volume_size': 2} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-284936129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d758393-e2ba-445a-8873-d8dd2a5def4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09226b66c6a04ef9a7809a585e095998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:14Z,use_quota=True,user_id='736e640d74874c89bad3b760182406a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Creating volume 3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:13 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e 2147483648 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:13 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e 2147483648 Sep 07 16:55:13 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:14 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e 2147483648" returned: 0 in 0.478s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:14 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e Sep 07 16:55:14 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:14 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e" returned: 0 in 0.259s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7479965-42dd-460e-8069-48dbd7f66960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d758393-e2ba-445a-8873-d8dd2a5def4e', 'volume_size': 2}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106de646-5513-4374-95a1-bb73fe18bcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Volume volume-3d758393-e2ba-445a-8873-d8dd2a5def4e (3d758393-e2ba-445a-8873-d8dd2a5def4e): created successfully Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106de646-5513-4374-95a1-bb73fe18bcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Flow 'volume_create_manager' (ee093236-d802-4246-a435-448b80eb40fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:14 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-990afbb4-bde9-4c57-b6ed-8c77b804d387 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Created volume successfully. Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Creating offline snapshot 8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 of volume 7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae80c02c-7a29-4c8c-9e26-2e2be767df89]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:14 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 Sep 07 16:55:14 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:15 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60" returned: 0 in 0.368s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:15 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 1G Sep 07 16:55:15 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:15 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 1G" returned: 0 in 0.515s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7954531d-6949-4606-b5b4-f3ea9567cd60 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:15 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7954531d-6949-4606-b5b4-f3ea9567cd60 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 Sep 07 16:55:15 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:16 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7954531d-6949-4606-b5b4-f3ea9567cd60 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" returned: 0 in 0.328s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:16 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 is being set with open permissions: ugo+rw Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:16 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 Sep 07 16:55:16 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:16 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" returned: 0 in 0.272s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:16 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.info Sep 07 16:55:16 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:16 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.info" returned: 0 in 0.272s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:16 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.info is being set with open permissions: ugo+rw Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:16 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.info Sep 07 16:55:16 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:16 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.info" returned: 0 in 0.252s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Creating offline snapshot d3123719-4ccc-4e00-9e56-4e3853c82a0c of volume 3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:55:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-05b116a8-fdc1-426c-92b6-a09d0efb0e9d tempest-CinderUnicodeTest-396305125 None] Create snapshot completed successfully Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d586d8d7-eaf8-4530-bab2-aa38e81a23bd]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:17 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e Sep 07 16:55:17 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:17 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e" returned: 0 in 0.377s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c 2G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:17 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c 2G Sep 07 16:55:17 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:17 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c 2G" returned: 0 in 0.402s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d758393-e2ba-445a-8873-d8dd2a5def4e -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:17 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d758393-e2ba-445a-8873-d8dd2a5def4e -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c Sep 07 16:55:17 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Acquiring lock "cinder-8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Lock "cinder-8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Acquiring lock "cinder-quobyte-7954531d-6949-4606-b5b4-f3ea9567cd60" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-7954531d-6949-4606-b5b4-f3ea9567cd60" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Acquiring lock "cinder-quobyte-8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Deleting offline snapshot 8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 of volume 7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] snapshot_file for this snap is: volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c659651d-e577-4970-a7ce-8b34720f4948]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:18 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d758393-e2ba-445a-8873-d8dd2a5def4e -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c" returned: 0 in 0.371s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:18 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c is being set with open permissions: ugo+rw Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:18 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c Sep 07 16:55:18 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:18 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 Sep 07 16:55:18 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:18 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c" returned: 0 in 0.270s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:18 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.info Sep 07 16:55:18 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:18 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" returned: 0 in 0.427s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7954531d-6949-4606-b5b4-f3ea9567cd60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce0c58e-ea69-4905-b266-f4da3e5864e3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:18 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 Sep 07 16:55:18 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:18 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.info" returned: 0 in 0.280s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:18 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.info is being set with open permissions: ugo+rw Sep 07 16:55:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:18 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.info Sep 07 16:55:18 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:19 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:19 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.info" returned: 0 in 0.264s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60" returned: 0 in 0.440s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:19 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 Sep 07 16:55:19 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-474f8dba-a631-4a37-b3ff-7e70f1750958 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Create snapshot completed successfully Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Flow 'volume_create_manager' (a97cf607-ce2b-4228-890e-028520bc1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0122b7b-f2e0-4a3b-b2c4-ca6bca9e6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0122b7b-f2e0-4a3b-b2c4-ca6bca9e6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-214568121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7e4c4b-0618-493d-b1ab-28dd69a83ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc7b1b95d944bb78ed050c7ac796a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:19Z,use_quota=True,user_id='49c59dc29e304d7aa0b7285adf2de595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cf0ed-806c-4829-83e5-c6c608d72941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cf0ed-806c-4829-83e5-c6c608d72941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e7daf-6d53-40fb-a46e-5b513ba1f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906e7daf-6d53-40fb-a46e-5b513ba1f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a7e4c4b-0618-493d-b1ab-28dd69a83ffb', 'volume_name': 'volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a657c78f-f9c3-499f-8ec1-66679a32efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a657c78f-f9c3-499f-8ec1-66679a32efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7992a4d3-5e7b-444f-9074-dca814f4c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:19 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb', 'volume_size': 1} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-214568121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7e4c4b-0618-493d-b1ab-28dd69a83ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc7b1b95d944bb78ed050c7ac796a10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:19Z,use_quota=True,user_id='49c59dc29e304d7aa0b7285adf2de595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Creating volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:19 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:19 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb 1073741824 Sep 07 16:55:19 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "cinder-d3123719-4ccc-4e00-9e56-4e3853c82a0c-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-d3123719-4ccc-4e00-9e56-4e3853c82a0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "cinder-quobyte-3d758393-e2ba-445a-8873-d8dd2a5def4e" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-quobyte-3d758393-e2ba-445a-8873-d8dd2a5def4e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "cinder-quobyte-d3123719-4ccc-4e00-9e56-4e3853c82a0c" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-quobyte-d3123719-4ccc-4e00-9e56-4e3853c82a0c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Deleting offline snapshot d3123719-4ccc-4e00-9e56-4e3853c82a0c of volume 3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] snapshot_file for this snap is: volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b253f-a8d2-4e84-b8cf-e78b32890587]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:19 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" returned: 0 in 0.392s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:19 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1 Sep 07 16:55:19 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:19 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c Sep 07 16:55:19 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:19 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb 1073741824" returned: 0 in 0.447s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:19 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb Sep 07 16:55:19 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:19 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c" returned: 0 in 0.369s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d758393-e2ba-445a-8873-d8dd2a5def4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:19 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60.8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" returned: 0 in 0.319s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[43875c00-dbbb-4f58-805d-2fb23c289d69]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1" released by "_delete_snapshot" :: held 1.691s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-7954531d-6949-4606-b5b4-f3ea9567cd60" released by "delete_snapshot" :: held 1.716s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Created reservations ['baf83246-244b-44dd-81da-70520e648a15', 'b6d441e8-686d-417b-a4d0-13ffd534346b', 'b140e849-3c99-44c8-9636-8b8db0dcf761', '57a94c65-602e-4321-81bc-ab7e6a65a268'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:19 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e Sep 07 16:55:19 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Delete snapshot completed successfully. Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-955fd8c9-26f8-4efe-8082-59231ff5cc7b tempest-CinderUnicodeTest-396305125 None] Lock "cinder-8ce9fad2-6c9a-4d85-890e-ba8a44e69bd1-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:19 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" returned: 0 in 0.261s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7992a4d3-5e7b-444f-9074-dca814f4c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53278a2c-e11e-42e2-8c35-7338864bf35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:19 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Volume volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb (1a7e4c4b-0618-493d-b1ab-28dd69a83ffb): created successfully Sep 07 16:55:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53278a2c-e11e-42e2-8c35-7338864bf35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Flow 'volume_create_manager' (a97cf607-ce2b-4228-890e-028520bc1b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:20 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0e639356-1a61-46e4-bff0-ebd45bd0eb82 tempest-VolumesSnapshotListTestJSON-1522786110 None] Created volume successfully. Sep 07 16:55:20 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e" returned: 0 in 0.392s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:20 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c Sep 07 16:55:20 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Acquiring lock "cinder-7954531d-6949-4606-b5b4-f3ea9567cd60-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Lock "cinder-7954531d-6949-4606-b5b4-f3ea9567cd60-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Acquiring lock "cinder-quobyte-7954531d-6949-4606-b5b4-f3ea9567cd60" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-7954531d-6949-4606-b5b4-f3ea9567cd60" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[433779cb-3850-4ef2-93bb-aebeabab9387]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Creating offline snapshot 615a702c-73da-4cb1-8ead-48810ff2cbe4 of volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638a8a8-4128-4fe4-815a-cc57a52d026f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:20 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 Sep 07 16:55:20 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:20 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c" returned: 0 in 0.388s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:20 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb Sep 07 16:55:20 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:20 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c Sep 07 16:55:20 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:20 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60" returned: 0 in 0.400s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:20 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e.d3123719-4ccc-4e00-9e56-4e3853c82a0c" returned: 0 in 0.269s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:20 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" returned: 0 in 0.384s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:20 devstack sudo[103164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60 Sep 07 16:55:20 devstack sudo[103164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:20 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 1G Sep 07 16:55:20 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-quobyte-d3123719-4ccc-4e00-9e56-4e3853c82a0c" released by "_delete_snapshot" :: held 1.542s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-quobyte-3d758393-e2ba-445a-8873-d8dd2a5def4e" released by "delete_snapshot" :: held 1.564s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:20 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Created reservations ['3bac5a04-9b12-462f-82a4-049ec4e9884c', 'f90f258c-dc94-4193-8fab-86c49f954233', '040aa456-4c46-4ecb-8782-1981ea8df802', 'fa973dc2-083c-464c-934c-8ca7a309f1ca'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Delete snapshot completed successfully. Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-502bebe6-6ec0-4c7a-9d3b-f6ac3fdc6e82 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-d3123719-4ccc-4e00-9e56-4e3853c82a0c-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:21 devstack sudo[103164]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7954531d-6949-4606-b5b4-f3ea9567cd60" returned: 0 in 0.247s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-7954531d-6949-4606-b5b4-f3ea9567cd60" released by "delete_volume" :: held 0.706s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Created reservations ['9aa23d15-b144-40b8-8907-4ce20c8306f1', '4b552e1a-3d8e-4d5c-b60c-1b08169aedcd', '3088b8e6-e628-4e26-8a6d-39566125898d', '4123a24c-7332-4ede-b082-52e30434841a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:21 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:21 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:21 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 1G" returned: 0 in 0.455s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:21 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 Sep 07 16:55:21 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Acquiring lock "cinder-2e1d5d3c-2ef8-4042-8428-affbea149886-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:21 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.279s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Lock "cinder-2e1d5d3c-2ef8-4042-8428-affbea149886-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Deleted volume successfully. Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2b7ed33-fe6d-47c1-af4f-1a2b49c24dfd tempest-CinderUnicodeTest-396305125 None] Lock "cinder-7954531d-6949-4606-b5b4-f3ea9567cd60-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Acquiring lock "cinder-quobyte-2e1d5d3c-2ef8-4042-8428-affbea149886" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "cinder-3d758393-e2ba-445a-8873-d8dd2a5def4e-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-2e1d5d3c-2ef8-4042-8428-affbea149886" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-3d758393-e2ba-445a-8873-d8dd2a5def4e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a8b77-5647-4d56-b98d-77c12b43d474]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "cinder-quobyte-3d758393-e2ba-445a-8873-d8dd2a5def4e" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-quobyte-3d758393-e2ba-445a-8873-d8dd2a5def4e" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:21 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4" returned: 0 in 0.404s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:21 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 is being set with open permissions: ugo+rw Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90bc637-6ba0-4083-ad85-946ace836744]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:21 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 Sep 07 16:55:21 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:21 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 Sep 07 16:55:21 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:21 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e Sep 07 16:55:21 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:21 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4" returned: 0 in 0.251s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:21 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886" returned: 0 in 0.393s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:21 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.info Sep 07 16:55:21 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:22 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886 Sep 07 16:55:22 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:22 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e" returned: 0 in 0.381s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:22 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e Sep 07 16:55:22 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:22 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.info" returned: 0 in 0.262s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:22 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.info is being set with open permissions: ugo+rw Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:22 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2e1d5d3c-2ef8-4042-8428-affbea149886" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:22 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.info Sep 07 16:55:22 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Lock "cinder-quobyte-2e1d5d3c-2ef8-4042-8428-affbea149886" released by "delete_volume" :: held 0.705s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Created reservations ['a033f9cb-d5e8-4850-80f0-0474ad450a10', '510e6da8-54d1-43f1-bac3-71424c2f7e77', '36192bf6-f97a-4513-a5db-beee03424e2f', '438bd11a-3319-40e6-8768-44ea6a4cd4bd'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:22 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3d758393-e2ba-445a-8873-d8dd2a5def4e" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-quobyte-3d758393-e2ba-445a-8873-d8dd2a5def4e" released by "delete_volume" :: held 0.718s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:22 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:22 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Created reservations ['2cfb6de6-d5f5-4cdd-b2d2-17931853ad9e', '47f6a424-dd4b-4189-a914-68c81ae035af', '078b4821-0ed5-47ed-b1c8-bcba6a6f885f', '98d318e2-fe4e-4b65-921e-685c5f3a0dcb'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:22 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.info" returned: 0 in 0.270s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2b5a5ae5-7538-4183-8170-c516dfe63aaa tempest-VolumesSnapshotListTestJSON-1522786110 None] Create snapshot completed successfully Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:22 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:22 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:22 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.310s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Deleted volume successfully. Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3650ba7d-41e3-4b44-8511-ada7cb3dfcd9 tempest-CinderUnicodeTest-396305125 None] Lock "cinder-2e1d5d3c-2ef8-4042-8428-affbea149886-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:22 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.295s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Deleted volume successfully. Sep 07 16:55:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ad7cc201-ed50-4554-85c7-2857debc9a75 tempest-VolumesSnapshotNegativeTestJSON-1348868769 None] Lock "cinder-3d758393-e2ba-445a-8873-d8dd2a5def4e-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Creating offline snapshot a8dc9fe5-001b-42b0-b522-92dfb5e82e1c of volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:55:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[88521fa8-a111-47b7-8f61-90a18922fde8]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:23 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 Sep 07 16:55:23 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:24 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4" returned: 0 in 0.490s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:24 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c 1G Sep 07 16:55:24 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:24 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c 1G" returned: 0 in 0.660s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:24 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c Sep 07 16:55:24 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:25 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:25 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c is being set with open permissions: ugo+rw Sep 07 16:55:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:25 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c Sep 07 16:55:25 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:25 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-82249c85-777c-4450-89db-f31ab5a528c7 tempest-VolumesSnapshotListTestJSON-1522786110 None] Create snapshot completed successfully Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Creating offline snapshot 04d71bff-b57f-41de-b759-99d1a03dccb6 of volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d72f8a1-161e-4596-84bf-8eed37d6cdd6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:26 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c Sep 07 16:55:26 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:26 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" returned: 0 in 0.469s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:26 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 1G Sep 07 16:55:26 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:27 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Flow 'volume_create_manager' (ae471f51-f27c-46fc-a7d3-523e6869bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d1116b-117f-4320-a445-fcb2480ae028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 1G" returned: 0 in 0.648s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:27 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 Sep 07 16:55:27 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d1116b-117f-4320-a445-fcb2480ae028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845293623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e450be7-7e43-4e7d-accd-7746aceef3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd82492da9c4bdf9b657cd427c0f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:27Z,use_quota=True,user_id='9bfd8a699b6546fb9d75bac0234eb40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036dffc4-68b8-49e3-8048-00e2ef18e41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036dffc4-68b8-49e3-8048-00e2ef18e41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b26594-cfe4-4575-b935-facfe4b5c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b26594-cfe4-4575-b935-facfe4b5c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e450be7-7e43-4e7d-accd-7746aceef3fc', 'volume_name': 'volume-5e450be7-7e43-4e7d-accd-7746aceef3fc', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daca0bf0-e64b-46a6-9053-aaf6c645e5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daca0bf0-e64b-46a6-9053-aaf6c645e5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b297bb5-8b0f-491f-bf6f-5ede973a55f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:27 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Volume 5e450be7-7e43-4e7d-accd-7746aceef3fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e450be7-7e43-4e7d-accd-7746aceef3fc', 'volume_size': 1} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:27 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6" returned: 0 in 0.325s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:27 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 is being set with open permissions: ugo+rw Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:27 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 Sep 07 16:55:27 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:27 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6" returned: 0 in 0.264s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.811s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845293623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e450be7-7e43-4e7d-accd-7746aceef3fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd82492da9c4bdf9b657cd427c0f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:27Z,use_quota=True,user_id='9bfd8a699b6546fb9d75bac0234eb40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Creating volume 5e450be7-7e43-4e7d-accd-7746aceef3fc {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:27 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:27 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc 1073741824 Sep 07 16:55:27 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2bdd4238-b4c0-4f05-a447-5daf1bff912d tempest-VolumesSnapshotListTestJSON-1522786110 None] Create snapshot completed successfully Sep 07 16:55:28 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc 1073741824" returned: 0 in 0.574s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:28 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc Sep 07 16:55:28 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:28 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc" returned: 0 in 0.280s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b297bb5-8b0f-491f-bf6f-5ede973a55f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e450be7-7e43-4e7d-accd-7746aceef3fc', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a33d53-1e8f-4367-9f60-354b20071e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:28 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Volume volume-5e450be7-7e43-4e7d-accd-7746aceef3fc (5e450be7-7e43-4e7d-accd-7746aceef3fc): created successfully Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a33d53-1e8f-4367-9f60-354b20071e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Flow 'volume_create_manager' (ae471f51-f27c-46fc-a7d3-523e6869bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fcb50ae6-11f8-4cec-ae1e-dbf79673006d tempest-ProjectReaderTests-634632967 None] Created volume successfully. Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-04d71bff-b57f-41de-b759-99d1a03dccb6-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-04d71bff-b57f-41de-b759-99d1a03dccb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-quobyte-04d71bff-b57f-41de-b759-99d1a03dccb6" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Acquiring lock "cinder-5e450be7-7e43-4e7d-accd-7746aceef3fc-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-04d71bff-b57f-41de-b759-99d1a03dccb6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Deleting offline snapshot 04d71bff-b57f-41de-b759-99d1a03dccb6 of volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] snapshot_file for this snap is: volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Lock "cinder-5e450be7-7e43-4e7d-accd-7746aceef3fc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[deddae5a-dc56-46c8-b3d3-b1e47df66356]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Acquiring lock "cinder-quobyte-5e450be7-7e43-4e7d-accd-7746aceef3fc" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Lock "cinder-quobyte-5e450be7-7e43-4e7d-accd-7746aceef3fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb6514-aff6-48db-86aa-7167e879a43e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:29 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 Sep 07 16:55:29 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:29 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc Sep 07 16:55:29 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:29 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6" returned: 0 in 0.480s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3283a2-38c5-450f-8cc1-573611ffaaac]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:29 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc" returned: 0 in 0.486s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:29 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc Sep 07 16:55:29 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:30 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c Sep 07 16:55:30 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:30 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-5e450be7-7e43-4e7d-accd-7746aceef3fc" returned: 0 in 0.280s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Lock "cinder-quobyte-5e450be7-7e43-4e7d-accd-7746aceef3fc" released by "delete_volume" :: held 0.816s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Created reservations ['790a144f-706d-4af2-a2ec-ac935f50a358', '599a2a6d-607a-489d-bd27-ce56e9c772b8', '52350cf8-5eb7-4a33-8ce4-4605e8c91343', '4c9101c8-f243-4d8f-8d75-e0a4e5aece84'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:30 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" returned: 0 in 0.479s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:30 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 Sep 07 16:55:30 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:30 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:30 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:30 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:30 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Deleted volume successfully. Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=200,cinder:UPDATE=247,cinder:DELETE=27,cinder:INSERT=56 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-de06d32e-00a9-47fc-b570-6ff351cd18ed tempest-ProjectReaderTests-634632967 None] Lock "cinder-5e450be7-7e43-4e7d-accd-7746aceef3fc-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:30 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6" returned: 0 in 0.590s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:30 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6 Sep 07 16:55:30 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=197,cinder:UPDATE=283,cinder:INSERT=74,cinder:DELETE=22 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Flow 'volume_create_manager' (2da86b8b-743b-404b-9ca2-464476b7ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815e211c-d6ce-40b9-bf5a-f92c99e01e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815e211c-d6ce-40b9-bf5a-f92c99e01e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944119972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2090fbe-9961-49e5-a2f8-0ae970124221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd82492da9c4bdf9b657cd427c0f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:31Z,use_quota=True,user_id='9bfd8a699b6546fb9d75bac0234eb40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99deba19-9389-4d39-a6c9-3da0e923023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99deba19-9389-4d39-a6c9-3da0e923023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e23d139-7c7b-4f5b-a5fc-3894e4f60a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e23d139-7c7b-4f5b-a5fc-3894e4f60a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2090fbe-9961-49e5-a2f8-0ae970124221', 'volume_name': 'volume-d2090fbe-9961-49e5-a2f8-0ae970124221', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790818d7-5bce-420a-9bfe-31b02d7b062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790818d7-5bce-420a-9bfe-31b02d7b062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24061d0b-c7fa-4361-8acd-b38bf88a7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:31 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Volume d2090fbe-9961-49e5-a2f8-0ae970124221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2090fbe-9961-49e5-a2f8-0ae970124221', 'volume_size': 1} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944119972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2090fbe-9961-49e5-a2f8-0ae970124221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffd82492da9c4bdf9b657cd427c0f018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:31Z,use_quota=True,user_id='9bfd8a699b6546fb9d75bac0234eb40f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Creating volume d2090fbe-9961-49e5-a2f8-0ae970124221 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:31 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:31 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 1073741824 Sep 07 16:55:31 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:31 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.04d71bff-b57f-41de-b759-99d1a03dccb6" returned: 0 in 0.443s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-04d71bff-b57f-41de-b759-99d1a03dccb6" released by "_delete_snapshot" :: held 2.130s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" released by "delete_snapshot" :: held 2.164s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Created reservations ['720bbf53-d694-48a9-9807-9197c0356a15', '812d6b90-062c-48a7-931a-b1f575b12b39', '7041256f-a758-448a-ac19-33004cf4d6ad', '07e335df-4802-452c-9645-058ac41be2b7'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Delete snapshot completed successfully. Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-965fd334-5d74-40de-b150-d48a343a4a3a tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-04d71bff-b57f-41de-b759-99d1a03dccb6-delete_snapshot" released by "delete_snapshot" :: held 2.512s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:31 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 1073741824" returned: 0 in 0.680s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:32 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 Sep 07 16:55:32 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:32 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221" returned: 0 in 0.265s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24061d0b-c7fa-4361-8acd-b38bf88a7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2090fbe-9961-49e5-a2f8-0ae970124221', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039c91c5-236d-4d06-bb85-6eb02b94ae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Volume volume-d2090fbe-9961-49e5-a2f8-0ae970124221 (d2090fbe-9961-49e5-a2f8-0ae970124221): created successfully Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039c91c5-236d-4d06-bb85-6eb02b94ae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Flow 'volume_create_manager' (2da86b8b-743b-404b-9ca2-464476b7ce12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fb9b5f29-02b2-49ff-b756-3dbdcdf488f0 tempest-ProjectReaderTests-634632967 None] Created volume successfully. Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-a8dc9fe5-001b-42b0-b522-92dfb5e82e1c-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-a8dc9fe5-001b-42b0-b522-92dfb5e82e1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-quobyte-a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Deleting offline snapshot a8dc9fe5-001b-42b0-b522-92dfb5e82e1c of volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] snapshot_file for this snap is: volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a953d87-1c3f-4315-b87d-6bc70f7d5854]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:32 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c Sep 07 16:55:32 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:33 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" returned: 0 in 0.435s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b706d2-824a-4bd3-8f25-a777164f8492]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:33 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 Sep 07 16:55:33 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Acquiring lock "cinder-d2090fbe-9961-49e5-a2f8-0ae970124221-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Lock "cinder-d2090fbe-9961-49e5-a2f8-0ae970124221-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Acquiring lock "cinder-quobyte-d2090fbe-9961-49e5-a2f8-0ae970124221" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Lock "cinder-quobyte-d2090fbe-9961-49e5-a2f8-0ae970124221" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c73fab3-1101-41ad-8613-34f67705fcb5]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:33 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:33 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:33 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 Sep 07 16:55:33 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:33 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4" returned: 0 in 0.578s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:33 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c Sep 07 16:55:33 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:33 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.328s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:55:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:55:34 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221" returned: 0 in 0.575s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:34 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221 Sep 07 16:55:34 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:34 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" returned: 0 in 0.485s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:34 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c Sep 07 16:55:34 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:34 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d2090fbe-9961-49e5-a2f8-0ae970124221" returned: 0 in 0.307s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Lock "cinder-quobyte-d2090fbe-9961-49e5-a2f8-0ae970124221" released by "delete_volume" :: held 0.950s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Created reservations ['e760200e-4860-4ebc-a7d8-3bfed1e6674e', '7dd992f5-f94f-42f5-94f9-912094b53509', 'ed573a96-915a-4dee-856d-03ebd2c693fd', 'c6b39e0c-80be-4ee7-b0ce-1efa060c33d3'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:34 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-a8dc9fe5-001b-42b0-b522-92dfb5e82e1c" released by "_delete_snapshot" :: held 1.942s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" released by "delete_snapshot" :: held 1.981s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:34 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:34 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Created reservations ['9ff0def9-0598-4a8a-9234-82020debe1c7', 'c02ebe76-4305-48ba-ae88-ff2fdab2f829', 'eb45d4d7-0a00-49b4-a311-f03b8a818643', '8c401467-0d86-4a8c-8876-0b0cd279cce1'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Delete snapshot completed successfully. Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7db5e04b-011d-4ca2-a6c1-e3b3ecee7753 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-a8dc9fe5-001b-42b0-b522-92dfb5e82e1c-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:34 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.373s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Deleted volume successfully. Sep 07 16:55:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1526e3a0-0d71-4728-9d6c-90ec44027cbd tempest-ProjectReaderTests-634632967 None] Lock "cinder-d2090fbe-9961-49e5-a2f8-0ae970124221-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-615a702c-73da-4cb1-8ead-48810ff2cbe4-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-615a702c-73da-4cb1-8ead-48810ff2cbe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-quobyte-615a702c-73da-4cb1-8ead-48810ff2cbe4" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-615a702c-73da-4cb1-8ead-48810ff2cbe4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Deleting offline snapshot 615a702c-73da-4cb1-8ead-48810ff2cbe4 of volume 1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] snapshot_file for this snap is: volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d484780-9590-4885-a186-addac1e9bdd0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:35 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 Sep 07 16:55:35 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:36 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4" returned: 0 in 0.461s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:55:36 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d8547-8bef-4ed6-9521-5bdfe17d96b6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:36 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb Sep 07 16:55:36 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:36 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" returned: 0 in 0.375s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:36 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 Sep 07 16:55:36 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:37 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4" returned: 0 in 0.420s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:37 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4 Sep 07 16:55:37 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:37 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb.615a702c-73da-4cb1-8ead-48810ff2cbe4" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-615a702c-73da-4cb1-8ead-48810ff2cbe4" released by "_delete_snapshot" :: held 1.672s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" released by "delete_snapshot" :: held 1.698s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Created reservations ['62522e77-807e-4243-9813-947cd0c3a141', '9bb85c37-2261-4d6c-8774-1a9b5b3a0c5c', 'fba88a4f-1882-443f-b656-4baa75fab2f2', '54e983e9-8966-4fed-bb68-1765fff51b98'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Delete snapshot completed successfully. Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d5370f17-5557-45f9-af89-31b9dc6b5d8d tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-615a702c-73da-4cb1-8ead-48810ff2cbe4-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c013da-c99d-4be6-8d8d-f1a9097a02a4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:38 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb Sep 07 16:55:38 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:38 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" returned: 0 in 0.415s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:38 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb Sep 07 16:55:38 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:38 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" returned: 0 in 0.267s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-quobyte-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb" released by "delete_volume" :: held 0.757s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Created reservations ['32ecbd58-4c48-4391-a48d-03a042170949', '3f101249-14f9-4c91-8501-e5dd821d6410', 'dabc11fe-2d2a-4420-98e5-73e5d70789cf', 'de140181-ae9d-4ed0-b137-52f2161d2252'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:39 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:55:39 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:39 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:39 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Deleted volume successfully. Sep 07 16:55:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b1c5e8ee-fcee-48a3-8c3c-340f94dc8d61 tempest-VolumesSnapshotListTestJSON-1522786110 None] Lock "cinder-1a7e4c4b-0618-493d-b1ab-28dd69a83ffb-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:48 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:55:49 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=35,cinder:SELECT=24,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Flow 'volume_create_manager' (5dcb2311-0811-49f6-98d8-b41ffe4e4bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578437cb-de60-4002-8970-c9b3d11ad3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578437cb-de60-4002-8970-c9b3d11ad3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-402063991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a689479-f257-43af-9729-c3d2c3446076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5f2edfa4a47508a3d22d6e30c62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:53Z,use_quota=True,user_id='5f46a60e90814c51a2cdda406ff1ce64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4116f88-9777-433e-a56f-f0e04758dabe),volume_type_id=b4116f88-9777-433e-a56f-f0e04758dabe)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46635964-f613-4ed7-8c4c-02efcdf0647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46635964-f613-4ed7-8c4c-02efcdf0647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289b2f08-20ec-4a9f-8c3a-0db90f82e954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289b2f08-20ec-4a9f-8c3a-0db90f82e954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a689479-f257-43af-9729-c3d2c3446076', 'volume_name': 'volume-2a689479-f257-43af-9729-c3d2c3446076', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a771f0b-c0d6-4ef8-8fa1-65f20f8620c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a771f0b-c0d6-4ef8-8fa1-65f20f8620c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b69e16-ba90-4ccc-a280-1571a1075384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:52 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume 2a689479-f257-43af-9729-c3d2c3446076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a689479-f257-43af-9729-c3d2c3446076', 'volume_size': 1} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-402063991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a689479-f257-43af-9729-c3d2c3446076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5f2edfa4a47508a3d22d6e30c62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:53Z,use_quota=True,user_id='5f46a60e90814c51a2cdda406ff1ce64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4116f88-9777-433e-a56f-f0e04758dabe),volume_type_id=b4116f88-9777-433e-a56f-f0e04758dabe)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Creating volume 2a689479-f257-43af-9729-c3d2c3446076 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:52 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:52 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 1073741824 Sep 07 16:55:52 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Flow 'volume_create_manager' (5a1d9646-dda1-475e-a982-ec512c012b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b1ecf8-53eb-42c4-a77f-bca634537441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b1ecf8-53eb-42c4-a77f-bca634537441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-327048005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8688ff3d-03b1-476d-9423-5c7ab7485ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5f2edfa4a47508a3d22d6e30c62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:53Z,use_quota=True,user_id='5f46a60e90814c51a2cdda406ff1ce64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70fc0c90-96f1-4f16-86c5-19b95ab8567f),volume_type_id=70fc0c90-96f1-4f16-86c5-19b95ab8567f)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb320fd-beee-466b-8c24-c6c74ab13d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb320fd-beee-466b-8c24-c6c74ab13d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ab7f39-a576-4ed7-9163-f4dee1d7b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ab7f39-a576-4ed7-9163-f4dee1d7b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8688ff3d-03b1-476d-9423-5c7ab7485ed7', 'volume_name': 'volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d25835-780b-4a1e-84fc-7c659a639862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d25835-780b-4a1e-84fc-7c659a639862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c805d2c-fb14-48b6-a11a-6d0832a76652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume 8688ff3d-03b1-476d-9423-5c7ab7485ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7', 'volume_size': 1} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:53 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 1073741824" returned: 0 in 0.600s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:53 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 Sep 07 16:55:53 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:53 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076" returned: 0 in 0.282s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-327048005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8688ff3d-03b1-476d-9423-5c7ab7485ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5f2edfa4a47508a3d22d6e30c62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:53Z,use_quota=True,user_id='5f46a60e90814c51a2cdda406ff1ce64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70fc0c90-96f1-4f16-86c5-19b95ab8567f),volume_type_id=70fc0c90-96f1-4f16-86c5-19b95ab8567f)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Creating volume 8688ff3d-03b1-476d-9423-5c7ab7485ed7 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:53 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:53 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 1073741824 Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b69e16-ba90-4ccc-a280-1571a1075384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a689479-f257-43af-9729-c3d2c3446076', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:53 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca91dd1-2f87-4d98-87f5-56074f57ba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume volume-2a689479-f257-43af-9729-c3d2c3446076 (2a689479-f257-43af-9729-c3d2c3446076): created successfully Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca91dd1-2f87-4d98-87f5-56074f57ba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Flow 'volume_create_manager' (5dcb2311-0811-49f6-98d8-b41ffe4e4bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-33dae72e-9919-4a0f-9b21-5de5057ffa94 tempest-TestInstancesWithCinderVolumes-1251360118 None] Created volume successfully. Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Flow 'volume_create_manager' (0eb9d894-1053-4b81-9196-fe0fb9e9daaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79027dc6-b38c-4f47-a8e3-962ab7e44e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79027dc6-b38c-4f47-a8e3-962ab7e44e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2030861308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d37c28-e090-430c-a210-0ffa2d8b7c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5f2edfa4a47508a3d22d6e30c62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:54Z,use_quota=True,user_id='5f46a60e90814c51a2cdda406ff1ce64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(729a995d-57ee-4a74-bb0b-e6dd5b62a8b7),volume_type_id=729a995d-57ee-4a74-bb0b-e6dd5b62a8b7)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b278dda-283e-45f4-b505-52b206a5d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b278dda-283e-45f4-b505-52b206a5d192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef5ff4f-2495-40b6-9848-fa5f7102b23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:55:54 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 1073741824" returned: 0 in 0.571s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef5ff4f-2495-40b6-9848-fa5f7102b23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89d37c28-e090-430c-a210-0ffa2d8b7c96', 'volume_name': 'volume-89d37c28-e090-430c-a210-0ffa2d8b7c96', 'volume_size': 1, 'image_id': '2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--759919056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06f5f2edfa4a47508a3d22d6e30c62f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'created_at': datetime.datetime(2026, 9, 7, 14, 55, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 55, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4/file', 'properties': {}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:54 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 Sep 07 16:55:54 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a553cc2-81d6-4d55-9135-3cc7f7d70dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a553cc2-81d6-4d55-9135-3cc7f7d70dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a23f546-2bfb-4c46-8ad8-16959d18e465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:54 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume 89d37c28-e090-430c-a210-0ffa2d8b7c96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89d37c28-e090-430c-a210-0ffa2d8b7c96', 'volume_size': 1, 'image_id': '2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--759919056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06f5f2edfa4a47508a3d22d6e30c62f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'created_at': datetime.datetime(2026, 9, 7, 14, 55, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 55, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4/file', 'properties': {}}, 'image_service': } Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Trying to clone 89d37c28-e090-430c-a210-0ffa2d8b7c96 from image 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:55:54 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c805d2c-fb14-48b6-a11a-6d0832a76652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca0b7a7-988b-449f-a64e-eafd89588267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:54 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 (8688ff3d-03b1-476d-9423-5c7ab7485ed7): created successfully Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca0b7a7-988b-449f-a64e-eafd89588267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Flow 'volume_create_manager' (5a1d9646-dda1-475e-a982-ec512c012b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:54 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a7483567-ad98-4173-919d-eb61aa72a57b tempest-TestInstancesWithCinderVolumes-1251360118 None] Created volume successfully. Sep 07 16:55:57 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD, size 20.69 MB, duration 3.53 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:55:57 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Image download 20.69 MB at 5.87 MB/s Sep 07 16:55:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad3ab7-11cc-4726-847d-3276fe41474a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:58 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD Sep 07 16:55:58 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:58 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Temporary image 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 is fetched for user 5f46a60e90814c51a2cdda406ff1ce64. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3461e516-81d8-4775-921e-f3c61c0c9b97]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:58 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD Sep 07 16:55:58 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:58 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2030861308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d37c28-e090-430c-a210-0ffa2d8b7c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f5f2edfa4a47508a3d22d6e30c62f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:54Z,use_quota=True,user_id='5f46a60e90814c51a2cdda406ff1ce64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(729a995d-57ee-4a74-bb0b-e6dd5b62a8b7),volume_type_id=729a995d-57ee-4a74-bb0b-e6dd5b62a8b7)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Creating volume 89d37c28-e090-430c-a210-0ffa2d8b7c96 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:58 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:55:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:58 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 1073741824 Sep 07 16:55:58 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:59 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 1073741824" returned: 0 in 0.455s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:59 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 Sep 07 16:55:59 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:59 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96" returned: 0 in 0.256s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Attempting download of 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'metadata': {}}])) to volume 89d37c28-e090-430c-a210-0ffa2d8b7c96. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1183f5e3-f38f-43a4-8cc5-27c593086853]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_tbn5anb4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:59 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_tbn5anb4 Sep 07 16:55:59 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:59 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_tbn5anb4" returned: 0 in 0.344s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_tbn5anb4 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:59 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_tbn5anb4 Sep 07 16:55:59 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:00 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_tbn5anb4" returned: 1 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_tbn5anb4' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:56:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2cddb7-6ea3-41db-ba0d-663831418b06]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:00 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD Sep 07 16:56:00 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:00 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:00 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 was qcow2, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:56:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:00 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 Sep 07 16:56:00 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:02 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96" returned: 0 in 2.200s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:02 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2cf9ae1e-77f3-4f3e-8790-ca4523df19a4_jyhnniuwdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:56:02 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Converted 112.00 MB image at 50.89 MB/s Sep 07 16:56:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:02 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 1G Sep 07 16:56:02 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:03 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 1G" returned: 0 in 0.402s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Downloaded image 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'metadata': {}}])) to volume 89d37c28-e090-430c-a210-0ffa2d8b7c96 successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Temporary image 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 for user 5f46a60e90814c51a2cdda406ff1ce64 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Marking volume 89d37c28-e090-430c-a210-0ffa2d8b7c96 as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Copying metadata from image 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 to 89d37c28-e090-430c-a210-0ffa2d8b7c96. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Creating volume glance metadata for volume 89d37c28-e090-430c-a210-0ffa2d8b7c96 backed by image 2cf9ae1e-77f3-4f3e-8790-ca4523df19a4 with: {'image_id': '2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'image_name': 'tempest-scenario-img--759919056', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a23f546-2bfb-4c46-8ad8-16959d18e465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d37c28-e090-430c-a210-0ffa2d8b7c96', 'volume_size': 1, 'image_id': '2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--759919056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '06f5f2edfa4a47508a3d22d6e30c62f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2cf9ae1e-77f3-4f3e-8790-ca4523df19a4', 'created_at': datetime.datetime(2026, 9, 7, 14, 55, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 55, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2cf9ae1e-77f3-4f3e-8790-ca4523df19a4/file', 'properties': {}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632681a9-f0ef-4c20-a732-8177c31c26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Volume volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 (89d37c28-e090-430c-a210-0ffa2d8b7c96): created successfully Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632681a9-f0ef-4c20-a732-8177c31c26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Flow 'volume_create_manager' (0eb9d894-1053-4b81-9196-fe0fb9e9daaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-923bed02-b3e4-4e0d-9c6d-292ec7f5d12a tempest-TestInstancesWithCinderVolumes-1251360118 None] Created volume successfully. Sep 07 16:56:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-acc83941-6492-4a1e-a6d5-9cb9c8329ff0 req-63205e01-e4da-4746-a279-9c24ff342d65 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-acc83941-6492-4a1e-a6d5-9cb9c8329ff0 req-63205e01-e4da-4746-a279-9c24ff342d65 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-acc83941-6492-4a1e-a6d5-9cb9c8329ff0 req-63205e01-e4da-4746-a279-9c24ff342d65 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-acc83941-6492-4a1e-a6d5-9cb9c8329ff0 req-63205e01-e4da-4746-a279-9c24ff342d65 tempest-TestInstancesWithCinderVolumes-1251360118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-89d37c28-e090-430c-a210-0ffa2d8b7c96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65bd0fb1-6c86-4a05-854b-ab8a379d3380', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:56:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-acc83941-6492-4a1e-a6d5-9cb9c8329ff0 req-63205e01-e4da-4746-a279-9c24ff342d65 tempest-TestInstancesWithCinderVolumes-1251360118 None] attachment_update completed successfully. Sep 07 16:56:16 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:56:16 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=16,cinder:SELECT=20,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:33 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:56:33 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:33 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.259s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:56:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:56:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-bc7b504c-c52b-402e-bd47-82c13e1643a2 req-61c9af9c-0bdf-4ad5-9b0c-e3f17e2c25c0 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-bc7b504c-c52b-402e-bd47-82c13e1643a2 req-61c9af9c-0bdf-4ad5-9b0c-e3f17e2c25c0 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-bc7b504c-c52b-402e-bd47-82c13e1643a2 req-61c9af9c-0bdf-4ad5-9b0c-e3f17e2c25c0 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-bc7b504c-c52b-402e-bd47-82c13e1643a2 req-61c9af9c-0bdf-4ad5-9b0c-e3f17e2c25c0 tempest-TestInstancesWithCinderVolumes-1251360118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-2a689479-f257-43af-9729-c3d2c3446076', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a2f1fe3-e341-4156-aaba-74401a9ca20c', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:56:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-bc7b504c-c52b-402e-bd47-82c13e1643a2 req-61c9af9c-0bdf-4ad5-9b0c-e3f17e2c25c0 tempest-TestInstancesWithCinderVolumes-1251360118 None] attachment_update completed successfully. Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Flow 'volume_create_manager' (162ea015-6b59-4e5c-a774-df7f3e3e1cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8c28e6-c807-48d6-925f-7c84e2d5af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8c28e6-c807-48d6-925f-7c84e2d5af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-231147739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0350bd9b-a8e8-4101-84c4-5e6db499b0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bc8ddfd25e4f0a935e924447d87291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:44Z,use_quota=True,user_id='1a9df77906cb43248ce8431ad82dd2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0bf5c4-c6d8-4b70-a5f6-4e529aeec19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0bf5c4-c6d8-4b70-a5f6-4e529aeec19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf50f197-7a42-40a4-b223-030097adf9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf50f197-7a42-40a4-b223-030097adf9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0350bd9b-a8e8-4101-84c4-5e6db499b0b6', 'volume_name': 'volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae45cd3-d52b-416c-a3b6-a5683ad470ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae45cd3-d52b-416c-a3b6-a5683ad470ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8407bbcf-fda2-4601-95a2-9c12978a5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:43 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Volume 0350bd9b-a8e8-4101-84c4-5e6db499b0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6', 'volume_size': 1} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-231147739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0350bd9b-a8e8-4101-84c4-5e6db499b0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bc8ddfd25e4f0a935e924447d87291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:44Z,use_quota=True,user_id='1a9df77906cb43248ce8431ad82dd2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Creating volume 0350bd9b-a8e8-4101-84c4-5e6db499b0b6 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:56:43 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:56:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:43 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 1073741824 Sep 07 16:56:43 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:44 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 1073741824" returned: 0 in 0.453s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:44 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 Sep 07 16:56:44 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:44 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6" returned: 0 in 0.297s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8407bbcf-fda2-4601-95a2-9c12978a5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a71212-fcdf-44d3-9dfc-bbad46ea2982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:44 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Volume volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 (0350bd9b-a8e8-4101-84c4-5e6db499b0b6): created successfully Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a71212-fcdf-44d3-9dfc-bbad46ea2982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:44 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Flow 'volume_create_manager' (162ea015-6b59-4e5c-a774-df7f3e3e1cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:44 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9897af0a-09aa-466f-8060-30d817fc4f32 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Created volume successfully. Sep 07 16:56:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-e2cdaedc-f497-4b37-828d-3ff833fd243e req-dca76126-cd7c-4794-81a4-a2e251d10509 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-e2cdaedc-f497-4b37-828d-3ff833fd243e req-dca76126-cd7c-4794-81a4-a2e251d10509 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-e2cdaedc-f497-4b37-828d-3ff833fd243e req-dca76126-cd7c-4794-81a4-a2e251d10509 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-e2cdaedc-f497-4b37-828d-3ff833fd243e req-dca76126-cd7c-4794-81a4-a2e251d10509 tempest-TestInstancesWithCinderVolumes-1251360118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3985ab84-2636-4340-b3fb-490909e4a3c3', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:56:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-e2cdaedc-f497-4b37-828d-3ff833fd243e req-dca76126-cd7c-4794-81a4-a2e251d10509 tempest-TestInstancesWithCinderVolumes-1251360118 None] attachment_update completed successfully. Sep 07 16:56:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1056b00d-f860-437f-a33e-cf0338361160 req-00b87351-2e7a-4e0f-ae91-f607146afd72 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1056b00d-f860-437f-a33e-cf0338361160 req-00b87351-2e7a-4e0f-ae91-f607146afd72 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-1056b00d-f860-437f-a33e-cf0338361160 req-00b87351-2e7a-4e0f-ae91-f607146afd72 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-1056b00d-f860-437f-a33e-cf0338361160 req-00b87351-2e7a-4e0f-ae91-f607146afd72 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d68d7b7-89d3-4136-93b7-97a9fff3ebc3', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:56:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-1056b00d-f860-437f-a33e-cf0338361160 req-00b87351-2e7a-4e0f-ae91-f607146afd72 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] attachment_update completed successfully. Sep 07 16:56:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-f75cb3c7-6949-4c15-a868-03e9f6362417 req-4c403605-a49c-4331-b347-45d71b89fc50 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Terminate volume connection completed successfully. Sep 07 16:56:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-f75cb3c7-6949-4c15-a868-03e9f6362417 req-4c403605-a49c-4331-b347-45d71b89fc50 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Deleting attachment 9d68d7b7-89d3-4136-93b7-97a9fff3ebc3. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:56:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Acquiring lock "cinder-0350bd9b-a8e8-4101-84c4-5e6db499b0b6-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "cinder-0350bd9b-a8e8-4101-84c4-5e6db499b0b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Acquiring lock "cinder-quobyte-0350bd9b-a8e8-4101-84c4-5e6db499b0b6" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:49 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "cinder-quobyte-0350bd9b-a8e8-4101-84c4-5e6db499b0b6" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:49 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d03f2-52f9-41f8-a262-810cb419b950]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:49 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 Sep 07 16:56:49 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:50 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6" returned: 0 in 0.418s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:50 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6 Sep 07 16:56:50 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-c71aa5b1-ae85-4278-8ea7-7e97c9c47b11 req-a46d5c50-208c-4f77-a02c-6a755a953378 tempest-TestInstancesWithCinderVolumes-1251360118 None] Terminate volume connection completed successfully. Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-c71aa5b1-ae85-4278-8ea7-7e97c9c47b11 req-a46d5c50-208c-4f77-a02c-6a755a953378 tempest-TestInstancesWithCinderVolumes-1251360118 None] Deleting attachment 9a2f1fe3-e341-4156-aaba-74401a9ca20c. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:56:50 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0350bd9b-a8e8-4101-84c4-5e6db499b0b6" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "cinder-quobyte-0350bd9b-a8e8-4101-84c4-5e6db499b0b6" released by "delete_volume" :: held 0.729s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Created reservations ['98153872-f24e-4ab7-abd2-74545a1e4ff6', '44ffd9c9-1468-4486-8e19-e9cc3885fff7', '40017c7c-ebc6-49f1-bb9a-d54158d98110', 'af49d01d-c520-4060-93a8-01dad00b34cf'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:50 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:56:50 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:50 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.267s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Deleted volume successfully. Sep 07 16:56:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-225ae061-d200-4852-b038-8afba765be44 tempest-TestServerVolumeAttachScenarioOldVersion-410951376 None] Lock "cinder-0350bd9b-a8e8-4101-84c4-5e6db499b0b6-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "cinder-2a689479-f257-43af-9729-c3d2c3446076-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-2a689479-f257-43af-9729-c3d2c3446076-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "cinder-quobyte-2a689479-f257-43af-9729-c3d2c3446076" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-quobyte-2a689479-f257-43af-9729-c3d2c3446076" acquired by "delete_volume" :: waited 0.043s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[89683e18-2f04-4e7e-a0a4-c98b3d8d05b9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:51 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 Sep 07 16:56:51 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:51 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076" returned: 0 in 0.566s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:51 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076 Sep 07 16:56:51 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:52 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2a689479-f257-43af-9729-c3d2c3446076" returned: 0 in 0.298s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-quobyte-2a689479-f257-43af-9729-c3d2c3446076" released by "delete_volume" :: held 0.947s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:52 devstack cinder-volume[87492]: WARNING cinder.quota [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856409729-90207332 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856409729-90207332, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:56:52 devstack cinder-volume[87492]: WARNING cinder.quota [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856409729-90207332 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856409729-90207332, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Created reservations ['de40b98f-a329-48d6-9c62-4eb928debb01', '0a1c2d6c-4a73-42ca-b643-245ea9fa8e84', 'e299d4ff-696f-4a9f-b763-2d965cd68809', '45e85a8d-4a78-41ef-8fc6-7eec89711107'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:52 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:56:52 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:52 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Deleted volume successfully. Sep 07 16:56:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3da7b5dd-e2ac-4ca9-8dff-ad76e081e433 tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-2a689479-f257-43af-9729-c3d2c3446076-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-ee580482-3cf6-463c-b27e-6448a71f1a87 req-49cc8442-8637-45ad-937f-b02fa2631a2e tempest-TestInstancesWithCinderVolumes-1251360118 None] Terminate volume connection completed successfully. Sep 07 16:56:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-ee580482-3cf6-463c-b27e-6448a71f1a87 req-49cc8442-8637-45ad-937f-b02fa2631a2e tempest-TestInstancesWithCinderVolumes-1251360118 None] Deleting attachment 3985ab84-2636-4340-b3fb-490909e4a3c3. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "cinder-8688ff3d-03b1-476d-9423-5c7ab7485ed7-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-8688ff3d-03b1-476d-9423-5c7ab7485ed7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "cinder-quobyte-8688ff3d-03b1-476d-9423-5c7ab7485ed7" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-quobyte-8688ff3d-03b1-476d-9423-5c7ab7485ed7" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a028d179-dc93-4f6c-aade-dac09abf0242]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:56 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 Sep 07 16:56:56 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:56 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7" returned: 0 in 0.401s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:56 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7 Sep 07 16:56:56 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:57 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8688ff3d-03b1-476d-9423-5c7ab7485ed7" returned: 0 in 0.276s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-quobyte-8688ff3d-03b1-476d-9423-5c7ab7485ed7" released by "delete_volume" :: held 0.740s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:57 devstack cinder-volume[87492]: WARNING cinder.quota [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800604975-1763391344 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800604975-1763391344, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:56:57 devstack cinder-volume[87492]: WARNING cinder.quota [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800604975-1763391344 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1800604975-1763391344, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Created reservations ['59acc4cb-e1af-438e-a364-cf032c5fdce0', 'c6c94c7b-5c3a-47ff-90a1-58e9677216d3', '16f602e8-f6ec-48c8-aeaa-e63363740840', 'c47da197-2ecc-45cc-a792-a22debec7831'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:57 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:56:57 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:57 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.455s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Deleted volume successfully. Sep 07 16:56:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-3e2457dd-0ae3-44c1-b184-2dd9b251e29a tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-8688ff3d-03b1-476d-9423-5c7ab7485ed7-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-be63e304-f3e5-4950-8cdc-7cf4bc54d5fe req-ac2f1a7f-f256-4635-aa26-d58995d421b3 tempest-TestInstancesWithCinderVolumes-1251360118 None] Terminate volume connection completed successfully. Sep 07 16:57:01 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-be63e304-f3e5-4950-8cdc-7cf4bc54d5fe req-ac2f1a7f-f256-4635-aa26-d58995d421b3 tempest-TestInstancesWithCinderVolumes-1251360118 None] Deleting attachment 65bd0fb1-6c86-4a05-854b-ab8a379d3380. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:57:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "cinder-89d37c28-e090-430c-a210-0ffa2d8b7c96-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-89d37c28-e090-430c-a210-0ffa2d8b7c96-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "cinder-quobyte-89d37c28-e090-430c-a210-0ffa2d8b7c96" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-quobyte-89d37c28-e090-430c-a210-0ffa2d8b7c96" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:02 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b87ab0-b07d-4dbd-8069-955d7ea186b6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:02 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 Sep 07 16:57:02 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:03 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96" returned: 0 in 0.406s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:03 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96 Sep 07 16:57:03 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:03 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-89d37c28-e090-430c-a210-0ffa2d8b7c96" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-quobyte-89d37c28-e090-430c-a210-0ffa2d8b7c96" released by "delete_volume" :: held 0.758s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:03 devstack cinder-volume[87492]: WARNING cinder.quota [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1358276057-1384085658 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1358276057-1384085658, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:03 devstack cinder-volume[87492]: WARNING cinder.quota [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1358276057-1384085658 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1358276057-1384085658, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Created reservations ['dd87aa35-87b1-4ffb-b2d7-2799bfbd387e', 'e38a1d85-05b3-4403-8276-615d6f4471bc', '65341731-0db9-45b8-b31c-d4f6a1435e66', '2bd126a0-fbcd-49ba-aab3-fa174da49521'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:03 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:57:03 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:03 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Deleted volume successfully. Sep 07 16:57:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98d03eb9-d5e2-4028-95be-15c2b9edaa8b tempest-TestInstancesWithCinderVolumes-1251360118 None] Lock "cinder-89d37c28-e090-430c-a210-0ffa2d8b7c96-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:13 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=54,cinder:UPDATE=40,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:57:13 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=37,cinder:UPDATE=39,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Flow 'volume_create_manager' (2f295e31-0e2f-4184-aa9b-dee24d84af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298bbf6d-7e08-42dc-90a3-7aa4df4cdd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298bbf6d-7e08-42dc-90a3-7aa4df4cdd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e627ccac-eb49-4e70-8790-8de42223518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e201c8647d744347b91553a1cfd07541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:22Z,use_quota=True,user_id='20e3690a1eb24b589954022826aa3489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5572e814-1a80-4b00-b48f-f5d84ab6d74a),volume_type_id=5572e814-1a80-4b00-b48f-f5d84ab6d74a)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5460816-69e9-41fa-93b4-2698bb9fce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5460816-69e9-41fa-93b4-2698bb9fce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc542a1-4da9-49c3-8e4a-1802980c04ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:21 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc542a1-4da9-49c3-8e4a-1802980c04ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e627ccac-eb49-4e70-8790-8de42223518a', 'volume_name': 'volume-e627ccac-eb49-4e70-8790-8de42223518a', 'volume_size': 1, 'image_id': 'b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95fa98f5f3f9dee4edd8aaf512aba0b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e201c8647d744347b91553a1cfd07541', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed61f11ddc16ea86a94056e9b238aba4b90056fa1720a086838521c641ac88d1b78e05364774a9f8a77905aaab19952560990894fb9d1c8ccfbd566f3602e745', 'id': 'b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'created_at': datetime.datetime(2026, 9, 7, 14, 57, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1eac2bd-8b48-4a21-9233-5f26fb4ef585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1eac2bd-8b48-4a21-9233-5f26fb4ef585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013da85a-d764-4c88-bffa-8824286b082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:22 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Volume e627ccac-eb49-4e70-8790-8de42223518a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e627ccac-eb49-4e70-8790-8de42223518a', 'volume_size': 1, 'image_id': 'b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95fa98f5f3f9dee4edd8aaf512aba0b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e201c8647d744347b91553a1cfd07541', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed61f11ddc16ea86a94056e9b238aba4b90056fa1720a086838521c641ac88d1b78e05364774a9f8a77905aaab19952560990894fb9d1c8ccfbd566f3602e745', 'id': 'b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'created_at': datetime.datetime(2026, 9, 7, 14, 57, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Trying to clone e627ccac-eb49-4e70-8790-8de42223518a from image b8299bbe-ce68-40dc-82ff-e932859b0fdb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:57:22 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Image download 0.00 MB at 0.00 MB/s Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f98233-e5ae-443e-8711-aa731c6d2afb]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:22 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD Sep 07 16:57:22 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:22 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:22 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD Sep 07 16:57:22 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:23 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Temporary image b8299bbe-ce68-40dc-82ff-e932859b0fdb is fetched for user 20e3690a1eb24b589954022826aa3489. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb972ace-08a6-4827-ba26-2a9bd2dedb16]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:23 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD Sep 07 16:57:23 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:23 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:23 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD Sep 07 16:57:23 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:23 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e627ccac-eb49-4e70-8790-8de42223518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e201c8647d744347b91553a1cfd07541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:22Z,use_quota=True,user_id='20e3690a1eb24b589954022826aa3489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5572e814-1a80-4b00-b48f-f5d84ab6d74a),volume_type_id=5572e814-1a80-4b00-b48f-f5d84ab6d74a)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Creating volume e627ccac-eb49-4e70-8790-8de42223518a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:57:23 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:57:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:23 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a 1073741824 Sep 07 16:57:23 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:24 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a 1073741824" returned: 0 in 0.509s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:24 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a Sep 07 16:57:24 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:24 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a" returned: 0 in 0.253s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Attempting download of b8299bbe-ce68-40dc-82ff-e932859b0fdb ((None, [{'url': 'file:///opt/stack/data/glance/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'metadata': {}}])) to volume e627ccac-eb49-4e70-8790-8de42223518a. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edd6d71-ada1-44e1-9f33-aeca6206e2c7]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8299bbe-ce68-40dc-82ff-e932859b0fdb_obum1p4q {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:24 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8299bbe-ce68-40dc-82ff-e932859b0fdb_obum1p4q Sep 07 16:57:24 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:25 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8299bbe-ce68-40dc-82ff-e932859b0fdb_obum1p4q" returned: 0 in 0.357s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8299bbe-ce68-40dc-82ff-e932859b0fdb_obum1p4q {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:25 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8299bbe-ce68-40dc-82ff-e932859b0fdb_obum1p4q Sep 07 16:57:25 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:25 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8299bbe-ce68-40dc-82ff-e932859b0fdb_obum1p4q" returned: 1 in 0.364s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8299bbe-ce68-40dc-82ff-e932859b0fdb_obum1p4q' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d570dbb8-4792-4e4d-9d47-d443dd296bdd]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:25 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD Sep 07 16:57:25 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:25 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:25 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD Sep 07 16:57:25 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:26 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:57:26 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] b8299bbe-ce68-40dc-82ff-e932859b0fdb was raw, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:57:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:26 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a Sep 07 16:57:26 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:26 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a" returned: 0 in 0.512s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:26 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8299bbe-ce68-40dc-82ff-e932859b0fdb_x90zbxncdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:57:26 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 16:57:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:26 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a 1G Sep 07 16:57:26 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:27 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a 1G" returned: 0 in 0.340s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Downloaded image b8299bbe-ce68-40dc-82ff-e932859b0fdb ((None, [{'url': 'file:///opt/stack/data/glance/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'metadata': {}}])) to volume e627ccac-eb49-4e70-8790-8de42223518a successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Temporary image b8299bbe-ce68-40dc-82ff-e932859b0fdb for user 20e3690a1eb24b589954022826aa3489 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Marking volume e627ccac-eb49-4e70-8790-8de42223518a as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Copying metadata from image b8299bbe-ce68-40dc-82ff-e932859b0fdb to e627ccac-eb49-4e70-8790-8de42223518a. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Creating volume glance metadata for volume e627ccac-eb49-4e70-8790-8de42223518a backed by image b8299bbe-ce68-40dc-82ff-e932859b0fdb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '95fa98f5f3f9dee4edd8aaf512aba0b2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013da85a-d764-4c88-bffa-8824286b082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e627ccac-eb49-4e70-8790-8de42223518a', 'volume_size': 1, 'image_id': 'b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95fa98f5f3f9dee4edd8aaf512aba0b2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e201c8647d744347b91553a1cfd07541', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed61f11ddc16ea86a94056e9b238aba4b90056fa1720a086838521c641ac88d1b78e05364774a9f8a77905aaab19952560990894fb9d1c8ccfbd566f3602e745', 'id': 'b8299bbe-ce68-40dc-82ff-e932859b0fdb', 'created_at': datetime.datetime(2026, 9, 7, 14, 57, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 57, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8299bbe-ce68-40dc-82ff-e932859b0fdb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79cfdb56-2049-4611-a6de-b0b29b7b78b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:27 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Volume volume-e627ccac-eb49-4e70-8790-8de42223518a (e627ccac-eb49-4e70-8790-8de42223518a): created successfully Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79cfdb56-2049-4611-a6de-b0b29b7b78b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Flow 'volume_create_manager' (2f295e31-0e2f-4184-aa9b-dee24d84af6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2d1cd33e-755c-4360-b944-201d2dba6e1e tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Created volume successfully. Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Acquiring lock "cinder-e627ccac-eb49-4e70-8790-8de42223518a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "cinder-e627ccac-eb49-4e70-8790-8de42223518a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Acquiring lock "cinder-quobyte-e627ccac-eb49-4e70-8790-8de42223518a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "cinder-quobyte-e627ccac-eb49-4e70-8790-8de42223518a" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c7058-9241-4cfc-8127-8699d5165ec4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:28 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a Sep 07 16:57:28 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:28 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a" returned: 0 in 0.410s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:28 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a Sep 07 16:57:28 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:28 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e627ccac-eb49-4e70-8790-8de42223518a" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "cinder-quobyte-e627ccac-eb49-4e70-8790-8de42223518a" released by "delete_volume" :: held 0.744s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:29 devstack cinder-volume[87492]: WARNING cinder.quota [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:29 devstack cinder-volume[87492]: WARNING cinder.quota [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Created reservations ['78852587-f212-44f1-a3bc-520ddedc48c4', 'dd2c0295-b43b-43ca-b0b9-0e2228e67321', '9f0d72f6-ed41-4268-9ca1-65dd029e2707', '332abb7b-e66d-42c8-a2cf-c743422db3e7'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:29 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:57:29 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:29 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Deleted volume successfully. Sep 07 16:57:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-80a69cfb-a140-4908-b0dc-47bd1550b5c0 tempest-VolumeAndVolumeTypeFromImageTest-1207367995 None] Lock "cinder-e627ccac-eb49-4e70-8790-8de42223518a-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Flow 'volume_create_manager' (a39b0cef-dd02-4dfc-9423-9d0af9a4f978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f845cfb-5190-4746-a716-8878e546f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f845cfb-5190-4746-a716-8878e546f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1426611242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f7d091-b170-4545-b081-c0b964d7e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a0f42797a840d79caf7d38c8106c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:33Z,use_quota=True,user_id='a6ad6cf771a9405791a60a432915e1b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651cb8f4-22ec-4113-8eb4-5adcba2a5c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651cb8f4-22ec-4113-8eb4-5adcba2a5c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c277b8-0445-4e63-a293-8a031adc37fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c277b8-0445-4e63-a293-8a031adc37fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f7d091-b170-4545-b081-c0b964d7e0c3', 'volume_name': 'volume-13f7d091-b170-4545-b081-c0b964d7e0c3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3abf69-056f-44a6-b7ae-fbd2aa6ad3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3abf69-056f-44a6-b7ae-fbd2aa6ad3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e766a8d-fb04-482e-9c7f-7aa248e3d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Volume 13f7d091-b170-4545-b081-c0b964d7e0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f7d091-b170-4545-b081-c0b964d7e0c3', 'volume_size': 1} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1426611242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f7d091-b170-4545-b081-c0b964d7e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a0f42797a840d79caf7d38c8106c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:33Z,use_quota=True,user_id='a6ad6cf771a9405791a60a432915e1b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Creating volume 13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:57:32 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:33 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 1073741824 Sep 07 16:57:33 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:33 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:57:33 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:33 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 1073741824" returned: 0 in 0.562s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:33 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 Sep 07 16:57:33 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:33 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.308s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:57:33 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3" returned: 0 in 0.320s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e766a8d-fb04-482e-9c7f-7aa248e3d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f7d091-b170-4545-b081-c0b964d7e0c3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab546a95-620a-43f6-bce6-51c643bb94b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:33 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Volume volume-13f7d091-b170-4545-b081-c0b964d7e0c3 (13f7d091-b170-4545-b081-c0b964d7e0c3): created successfully Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab546a95-620a-43f6-bce6-51c643bb94b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Flow 'volume_create_manager' (a39b0cef-dd02-4dfc-9423-9d0af9a4f978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f06e6510-8867-421e-860e-9529c0fff0b1 tempest-TestStampPattern-1457889226 None] Created volume successfully. Sep 07 16:57:43 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:57:44 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-07963430-bf6a-4b71-b908-2c4da500fc28 req-299cdae9-3ce9-4311-91b0-e84b35375d9f tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-07963430-bf6a-4b71-b908-2c4da500fc28 req-299cdae9-3ce9-4311-91b0-e84b35375d9f tempest-TestStampPattern-1457889226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-07963430-bf6a-4b71-b908-2c4da500fc28 req-299cdae9-3ce9-4311-91b0-e84b35375d9f tempest-TestStampPattern-1457889226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-07963430-bf6a-4b71-b908-2c4da500fc28 req-299cdae9-3ce9-4311-91b0-e84b35375d9f tempest-TestStampPattern-1457889226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-13f7d091-b170-4545-b081-c0b964d7e0c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48597c86-1e71-457b-a674-fad86e07970c', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:58:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-07963430-bf6a-4b71-b908-2c4da500fc28 req-299cdae9-3ce9-4311-91b0-e84b35375d9f tempest-TestStampPattern-1457889226 None] attachment_update completed successfully. Sep 07 16:58:07 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-0f4ca694-a4f4-444c-b36d-577523c93e4e req-b4de4921-84ba-44e1-ad23-a35d980c690b tempest-TestStampPattern-1457889226 None] Terminate volume connection completed successfully. Sep 07 16:58:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-0f4ca694-a4f4-444c-b36d-577523c93e4e req-b4de4921-84ba-44e1-ad23-a35d980c690b tempest-TestStampPattern-1457889226 None] Deleting attachment 48597c86-1e71-457b-a674-fad86e07970c. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:58:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Creating offline snapshot f591aab1-a7d5-46f9-a28b-e3d88bf5b946 of volume 13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 16:58:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a781a0-d7fb-42d8-8cc1-624cf2b29a13]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:58:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:08 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 Sep 07 16:58:08 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:09 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:09 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 1G Sep 07 16:58:09 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:09 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 1G" returned: 0 in 0.392s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f7d091-b170-4545-b081-c0b964d7e0c3 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:09 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f7d091-b170-4545-b081-c0b964d7e0c3 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 Sep 07 16:58:09 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:09 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f7d091-b170-4545-b081-c0b964d7e0c3 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946" returned: 0 in 0.290s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:09 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 is being set with open permissions: ugo+rw Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:09 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 Sep 07 16:58:09 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:09 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:09 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.info Sep 07 16:58:09 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:10 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.info" returned: 0 in 0.267s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:10 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.info is being set with open permissions: ugo+rw Sep 07 16:58:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:10 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.info Sep 07 16:58:10 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:10 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.info" returned: 0 in 0.260s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:10 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-36d8193c-f856-43b1-b211-230140bf39a7 tempest-TestStampPattern-1457889226 None] Create snapshot completed successfully Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Flow 'volume_create_manager' (82905209-8dd2-4c3b-8f2e-a0a208a9e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74912706-52a3-41ca-afef-0ddea5003368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74912706-52a3-41ca-afef-0ddea5003368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1829947473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8c8de0-0f68-49f1-aa54-93c18454f8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a0f42797a840d79caf7d38c8106c42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f591aab1-a7d5-46f9-a28b-e3d88bf5b946,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:17Z,use_quota=True,user_id='a6ad6cf771a9405791a60a432915e1b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e517396-e0ca-4914-aa6e-b4df1a539ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e517396-e0ca-4914-aa6e-b4df1a539ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12fcd99-e4e5-433e-bceb-68dd1db03706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a12fcd99-e4e5-433e-bceb-68dd1db03706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb8c8de0-0f68-49f1-aa54-93c18454f8a1', 'volume_name': 'volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1', 'volume_size': 1, 'snapshot_id': 'f591aab1-a7d5-46f9-a28b-e3d88bf5b946'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc91aeed-3b84-46a6-9dfd-dbf1adc74346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc91aeed-3b84-46a6-9dfd-dbf1adc74346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f97333-69f2-4a01-bd32-a874817b9f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Volume fb8c8de0-0f68-49f1-aa54-93c18454f8a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1', 'volume_size': 1, 'snapshot_id': 'f591aab1-a7d5-46f9-a28b-e3d88bf5b946'} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-quobyte-f591aab1-a7d5-46f9-a28b-e3d88bf5b946-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-f591aab1-a7d5-46f9-a28b-e3d88bf5b946-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Creating volume fb8c8de0-0f68-49f1-aa54-93c18454f8a1 from snapshot f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-quobyte-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] snapshot: f591aab1-a7d5-46f9-a28b-e3d88bf5b946, volume: fb8c8de0-0f68-49f1-aa54-93c18454f8a1, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3684fe-a8df-4a6b-96b6-4c0616ff8dbd]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:17 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 Sep 07 16:58:17 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:17 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946" returned: 0 in 0.385s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f7d091-b170-4545-b081-c0b964d7e0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d02a301-47e2-4a49-9b97-7ac46c7b19b2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:58:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:18 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 Sep 07 16:58:18 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:18 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3" returned: 0 in 0.398s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 16:58:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 16:58:18 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 16:58:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:18 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 Sep 07 16:58:18 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:23 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" returned: 0 in 5.566s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:23 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:58:23 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Converted 1024.00 MB image at 183.89 MB/s Sep 07 16:58:23 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 is being set with open permissions: ugo+rw Sep 07 16:58:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:23 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 Sep 07 16:58:23 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:24 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" returned: 0 in 0.326s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" released by "_copy_volume_from_snapshot" :: held 6.771s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-f591aab1-a7d5-46f9-a28b-e3d88bf5b946-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" released by "_create_volume_from_snapshot" :: held 6.896s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.911s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f97333-69f2-4a01-bd32-a874817b9f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1', 'volume_size': 1, 'snapshot_id': 'f591aab1-a7d5-46f9-a28b-e3d88bf5b946'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b020960-f9fb-4aad-a920-78479c712414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:24 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Volume volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 (fb8c8de0-0f68-49f1-aa54-93c18454f8a1): created successfully Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b020960-f9fb-4aad-a920-78479c712414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Flow 'volume_create_manager' (82905209-8dd2-4c3b-8f2e-a0a208a9e57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:24 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-68a08994-3a17-430c-b1cd-5e5707bec310 tempest-TestStampPattern-1457889226 None] Created volume successfully. Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:33 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:58:33 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:33 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.261s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:58:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:58:34 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:34 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-8d823c30-c558-4623-8bb9-5cce46b2af43 req-ed3aefe1-e859-41b1-9b98-8847b557d083 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-8d823c30-c558-4623-8bb9-5cce46b2af43 req-ed3aefe1-e859-41b1-9b98-8847b557d083 tempest-TestStampPattern-1457889226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [req-8d823c30-c558-4623-8bb9-5cce46b2af43 req-ed3aefe1-e859-41b1-9b98-8847b557d083 tempest-TestStampPattern-1457889226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-8d823c30-c558-4623-8bb9-5cce46b2af43 req-ed3aefe1-e859-41b1-9b98-8847b557d083 tempest-TestStampPattern-1457889226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d', 'name': 'volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '985d346d-94f9-4e01-9be9-4b0728dcd530', 'enforce_multipath': True} {{(pid=87492) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:58:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-8d823c30-c558-4623-8bb9-5cce46b2af43 req-ed3aefe1-e859-41b1-9b98-8847b557d083 tempest-TestStampPattern-1457889226 None] attachment_update completed successfully. Sep 07 16:58:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [req-2aa3174b-843f-4e54-9341-42eed4b0c1d7 req-e97089a4-5986-45f4-a1d3-54d1a50022ef tempest-TestStampPattern-1457889226 None] Terminate volume connection completed successfully. Sep 07 16:58:57 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [req-2aa3174b-843f-4e54-9341-42eed4b0c1d7 req-e97089a4-5986-45f4-a1d3-54d1a50022ef tempest-TestStampPattern-1457889226 None] Deleting attachment 985d346d-94f9-4e01-9be9-4b0728dcd530. {{(pid=87492) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-fb8c8de0-0f68-49f1-aa54-93c18454f8a1-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Lock "cinder-fb8c8de0-0f68-49f1-aa54-93c18454f8a1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-quobyte-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0077d5-1af7-4aed-a77c-93b450e4ef11]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:01 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 Sep 07 16:59:01 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:01 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" returned: 0 in 0.388s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:01 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1 Sep 07 16:59:01 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:02 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" returned: 0 in 0.265s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-fb8c8de0-0f68-49f1-aa54-93c18454f8a1" released by "delete_volume" :: held 0.693s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Created reservations ['6aa2b1bb-f88c-4a8f-91e5-ba7774adefd5', '50457195-963c-4b70-b4e6-1642603e6316', '5e0347f2-31ee-453a-aaf0-4b8210cf2f68', '0c199882-bcce-4fa8-b1cd-e45eb40b6c23'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:02 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:02 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:02 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.280s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Deleted volume successfully. Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7493ae12-fd07-49c4-9670-6fc08004bd9a tempest-TestStampPattern-1457889226 None] Lock "cinder-fb8c8de0-0f68-49f1-aa54-93c18454f8a1-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-f591aab1-a7d5-46f9-a28b-e3d88bf5b946-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Lock "cinder-f591aab1-a7d5-46f9-a28b-e3d88bf5b946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-quobyte-13f7d091-b170-4545-b081-c0b964d7e0c3" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-13f7d091-b170-4545-b081-c0b964d7e0c3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-quobyte-f591aab1-a7d5-46f9-a28b-e3d88bf5b946" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-f591aab1-a7d5-46f9-a28b-e3d88bf5b946" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Deleting offline snapshot f591aab1-a7d5-46f9-a28b-e3d88bf5b946 of volume 13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 16:59:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] snapshot_file for this snap is: volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[248ae677-7883-4e64-b3df-01b893dc4a53]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:03 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 Sep 07 16:59:03 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:03 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946" returned: 0 in 0.381s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f7d091-b170-4545-b081-c0b964d7e0c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242e7ab-8926-4854-b6e2-1a43c5da79d6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:03 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 Sep 07 16:59:03 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:03 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3" returned: 0 in 0.542s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:03 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 Sep 07 16:59:03 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:04 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946" returned: 0 in 0.335s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:04 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946 Sep 07 16:59:04 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:04 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3.f591aab1-a7d5-46f9-a28b-e3d88bf5b946" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-f591aab1-a7d5-46f9-a28b-e3d88bf5b946" released by "_delete_snapshot" :: held 1.610s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-13f7d091-b170-4545-b081-c0b964d7e0c3" released by "delete_snapshot" :: held 1.635s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:04 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Created reservations ['2ba1134c-a7de-447e-9af6-91ff3271caed', '12ec66b8-aabc-4571-950f-1689d8f82f67', 'c9ef188b-edfc-4a5f-bf16-389ab35d260e', '8158597c-062d-4848-9885-8e85d76bc059'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Delete snapshot completed successfully. Sep 07 16:59:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4a962ede-659b-43b4-b4df-867077ee8229 tempest-TestStampPattern-1457889226 None] Lock "cinder-f591aab1-a7d5-46f9-a28b-e3d88bf5b946-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-13f7d091-b170-4545-b081-c0b964d7e0c3-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Lock "cinder-13f7d091-b170-4545-b081-c0b964d7e0c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Acquiring lock "cinder-quobyte-13f7d091-b170-4545-b081-c0b964d7e0c3" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-13f7d091-b170-4545-b081-c0b964d7e0c3" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:08 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[092c1804-1039-441a-91fd-d1d278b94807]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:08 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 Sep 07 16:59:08 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:09 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3" returned: 0 in 0.404s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:09 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3 Sep 07 16:59:09 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:09 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-13f7d091-b170-4545-b081-c0b964d7e0c3" returned: 0 in 0.246s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Lock "cinder-quobyte-13f7d091-b170-4545-b081-c0b964d7e0c3" released by "delete_volume" :: held 0.711s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Created reservations ['ac825196-1db3-4cc2-b450-19a69ad4fe5c', 'abfd2c53-304c-4a42-8d22-238e0f06d228', '8198edd3-c2c0-4d71-af25-737e8bbd6373', 'd4136f2c-8490-408f-868f-f8e4afe3e83d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:09 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:09 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:09 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Deleted volume successfully. Sep 07 16:59:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-bf226dc4-e196-456c-a49d-359994fa5921 tempest-TestStampPattern-1457889226 None] Lock "cinder-13f7d091-b170-4545-b081-c0b964d7e0c3-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:19 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:59:19 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (6c76ae0d-a58f-4024-8b95-f0351b344ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bd8628-9a73-4607-b318-60efb188730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bd8628-9a73-4607-b318-60efb188730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-568123156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389adc21-1746-4967-b570-ad96a6067212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:23Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab6a7fe-4997-48f1-91f3-75c819c8d85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab6a7fe-4997-48f1-91f3-75c819c8d85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3199fea-2505-4417-a36d-f22882df9974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3199fea-2505-4417-a36d-f22882df9974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '389adc21-1746-4967-b570-ad96a6067212', 'volume_name': 'volume-389adc21-1746-4967-b570-ad96a6067212', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b70a36-f857-4f74-88a5-b4cf0560c2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b70a36-f857-4f74-88a5-b4cf0560c2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e927eac6-4cf8-4d4d-9367-b528e6a1cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:23 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume 389adc21-1746-4967-b570-ad96a6067212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-389adc21-1746-4967-b570-ad96a6067212', 'volume_size': 1} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-568123156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389adc21-1746-4967-b570-ad96a6067212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:23Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Creating volume 389adc21-1746-4967-b570-ad96a6067212 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:59:23 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:23 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 1073741824 Sep 07 16:59:23 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:23 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 1073741824" returned: 0 in 0.443s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:23 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 Sep 07 16:59:23 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:23 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212" returned: 0 in 0.227s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e927eac6-4cf8-4d4d-9367-b528e6a1cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389adc21-1746-4967-b570-ad96a6067212', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317ce77e-33fd-4ec1-981f-e2ef4a930a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:23 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume volume-389adc21-1746-4967-b570-ad96a6067212 (389adc21-1746-4967-b570-ad96a6067212): created successfully Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317ce77e-33fd-4ec1-981f-e2ef4a930a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (6c76ae0d-a58f-4024-8b95-f0351b344ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d818d6c3-c634-4fc7-ba2a-03b2e8ca7144 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created volume successfully. Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (1393b1ab-f280-42fd-9cec-b93026f2429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb73a511-c13b-45fc-b307-1fcf77f5f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb73a511-c13b-45fc-b307-1fcf77f5f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597202608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd5920d-8d7b-4812-b1af-c06c43f260e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:25Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fd07ba-73d8-4800-aa7f-e4e994b1d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fd07ba-73d8-4800-aa7f-e4e994b1d671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f79853-f010-436e-92a1-277ecdfe8fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f79853-f010-436e-92a1-277ecdfe8fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd5920d-8d7b-4812-b1af-c06c43f260e3', 'volume_name': 'volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f751b8da-3416-43ff-a527-488de9f3f7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f751b8da-3416-43ff-a527-488de9f3f7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0636d3e-1bd6-4c4c-ab3e-29ce9fc32b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:24 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume fbd5920d-8d7b-4812-b1af-c06c43f260e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3', 'volume_size': 1} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597202608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd5920d-8d7b-4812-b1af-c06c43f260e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:25Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Creating volume fbd5920d-8d7b-4812-b1af-c06c43f260e3 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:59:24 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:24 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 1073741824 Sep 07 16:59:24 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (c8c4fac1-b76e-4a20-9e82-c98747f4356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc46e8-4c2d-463d-8670-e40b987c8f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc46e8-4c2d-463d-8670-e40b987c8f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535143700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb6fa75-4a5c-4430-93e1-34c7b1cb3922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:25Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:24 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2b6fa8-096c-4fe5-8ea1-5b4c37f9ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2b6fa8-096c-4fe5-8ea1-5b4c37f9ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59ddf8f-aa36-42a1-82ca-defcbe0dcfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59ddf8f-aa36-42a1-82ca-defcbe0dcfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb6fa75-4a5c-4430-93e1-34c7b1cb3922', 'volume_name': 'volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c62a0e-a1b8-472a-ab4c-d12c41b75fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c62a0e-a1b8-472a-ab4c-d12c41b75fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3933550c-78b7-49e9-86be-290de8c790ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume 3bb6fa75-4a5c-4430-93e1-34c7b1cb3922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922', 'volume_size': 1} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:25 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 1073741824" returned: 0 in 0.506s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:25 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 Sep 07 16:59:25 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (85e31bdb-13cf-4231-ba09-798ddf20ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2ba2eb-91f2-40d1-baa4-941d13b94c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2ba2eb-91f2-40d1-baa4-941d13b94c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617847927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feca14f-c4e2-4dae-a823-cafdb568c821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:25Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3169d18a-7a2f-47ab-8fef-60a03c2d0250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3169d18a-7a2f-47ab-8fef-60a03c2d0250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3da2156-d5c5-4b24-b600-303656b04c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3da2156-d5c5-4b24-b600-303656b04c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3feca14f-c4e2-4dae-a823-cafdb568c821', 'volume_name': 'volume-3feca14f-c4e2-4dae-a823-cafdb568c821', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42c8414-3212-4c0b-a0fd-2e8e027db3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42c8414-3212-4c0b-a0fd-2e8e027db3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e577382b-8d9f-4b51-a2fc-2b49eda44c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume 3feca14f-c4e2-4dae-a823-cafdb568c821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3feca14f-c4e2-4dae-a823-cafdb568c821', 'volume_size': 1} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:25 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3" returned: 0 in 0.307s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535143700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bb6fa75-4a5c-4430-93e1-34c7b1cb3922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:25Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Creating volume 3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:59:25 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0636d3e-1bd6-4c4c-ab3e-29ce9fc32b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 1073741824 Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984d5860-f86f-432d-9faf-8017d7e82adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 (fbd5920d-8d7b-4812-b1af-c06c43f260e3): created successfully Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984d5860-f86f-432d-9faf-8017d7e82adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (1393b1ab-f280-42fd-9cec-b93026f2429c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fad102df-4d58-4d69-bf58-d1c095713ea0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created volume successfully. Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (89303a1e-078d-4298-9390-1f7c73dac830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d591b0b-051d-4782-9a2e-11ac0a0bb220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d591b0b-051d-4782-9a2e-11ac0a0bb220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936498591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf30e6a-0625-4808-9070-1ed3598133fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:26Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45092c3-7e12-43dd-89cd-4469fa01d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45092c3-7e12-43dd-89cd-4469fa01d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9842b37-79e2-49df-86e9-2360b944faee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9842b37-79e2-49df-86e9-2360b944faee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf30e6a-0625-4808-9070-1ed3598133fd', 'volume_name': 'volume-1cf30e6a-0625-4808-9070-1ed3598133fd', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f084f41-31e5-4a5d-bb2c-63321db420d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f084f41-31e5-4a5d-bb2c-63321db420d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6326e7d0-0720-4191-b074-042f65bf6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume 1cf30e6a-0625-4808-9070-1ed3598133fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf30e6a-0625-4808-9070-1ed3598133fd', 'volume_size': 1} Sep 07 16:59:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:26 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 1073741824" returned: 0 in 0.535s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:26 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 Sep 07 16:59:26 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (2441d89f-144e-4c54-8c12-708e49ee9aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e707866-637f-4d73-a720-be94d8a949e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e707866-637f-4d73-a720-be94d8a949e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296292290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb7c002-4901-4253-9986-3fc4b2b94b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:26Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a762c2-8f1d-48c2-94b3-bb02aaf57174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a762c2-8f1d-48c2-94b3-bb02aaf57174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf63861-f598-4d72-ae1f-9c9d95320f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf63861-f598-4d72-ae1f-9c9d95320f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb7c002-4901-4253-9986-3fc4b2b94b27', 'volume_name': 'volume-0fb7c002-4901-4253-9986-3fc4b2b94b27', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28d83fa-2e64-4524-812f-dc7a86c4da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28d83fa-2e64-4524-812f-dc7a86c4da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603dcb95-316c-47fc-8e04-00a4763da667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume 0fb7c002-4901-4253-9986-3fc4b2b94b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb7c002-4901-4253-9986-3fc4b2b94b27', 'volume_size': 1} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:26 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1617847927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feca14f-c4e2-4dae-a823-cafdb568c821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:25Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Creating volume 3feca14f-c4e2-4dae-a823-cafdb568c821 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:59:26 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3933550c-78b7-49e9-86be-290de8c790ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ee6a40-53c9-4738-a3ab-c294fe02af44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:26 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 1073741824 Sep 07 16:59:26 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:26 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 (3bb6fa75-4a5c-4430-93e1-34c7b1cb3922): created successfully Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ee6a40-53c9-4738-a3ab-c294fe02af44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (c8c4fac1-b76e-4a20-9e82-c98747f4356c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-eb5f10ae-4582-4ac4-acb9-5c51fa8338d0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created volume successfully. Sep 07 16:59:26 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 1073741824" returned: 0 in 0.445s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:26 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 Sep 07 16:59:26 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:27 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821" returned: 0 in 0.248s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936498591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf30e6a-0625-4808-9070-1ed3598133fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:26Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Creating volume 1cf30e6a-0625-4808-9070-1ed3598133fd {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:59:27 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e577382b-8d9f-4b51-a2fc-2b49eda44c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3feca14f-c4e2-4dae-a823-cafdb568c821', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:27 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd 1073741824 Sep 07 16:59:27 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f11fe1-0b0d-4512-a0e9-79722a650580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:27 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume volume-3feca14f-c4e2-4dae-a823-cafdb568c821 (3feca14f-c4e2-4dae-a823-cafdb568c821): created successfully Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f11fe1-0b0d-4512-a0e9-79722a650580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (85e31bdb-13cf-4231-ba09-798ddf20ff91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e98b599a-0648-4061-9419-77881d6447c6 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created volume successfully. Sep 07 16:59:27 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd 1073741824" returned: 0 in 0.441s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:27 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd Sep 07 16:59:27 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:27 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296292290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb7c002-4901-4253-9986-3fc4b2b94b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0da8967e2e44f0b670529819d0da84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:26Z,use_quota=True,user_id='ff642d70d87f4024bc565369f05cb01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Creating volume 0fb7c002-4901-4253-9986-3fc4b2b94b27 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:59:27 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6326e7d0-0720-4191-b074-042f65bf6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf30e6a-0625-4808-9070-1ed3598133fd', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:27 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efe4495-a76f-460d-ba5e-11914b1a864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:27 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 1073741824 Sep 07 16:59:27 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:27 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume volume-1cf30e6a-0625-4808-9070-1ed3598133fd (1cf30e6a-0625-4808-9070-1ed3598133fd): created successfully Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efe4495-a76f-460d-ba5e-11914b1a864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (89303a1e-078d-4298-9390-1f7c73dac830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4a1e9ee3-84f6-4970-8311-95d538bae291 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created volume successfully. Sep 07 16:59:28 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 1073741824" returned: 0 in 0.459s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:28 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 Sep 07 16:59:28 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:28 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603dcb95-316c-47fc-8e04-00a4763da667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb7c002-4901-4253-9986-3fc4b2b94b27', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e95ecab-22dd-4d81-ba7d-72eb2268f030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:28 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Volume volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 (0fb7c002-4901-4253-9986-3fc4b2b94b27): created successfully Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e95ecab-22dd-4d81-ba7d-72eb2268f030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Flow 'volume_create_manager' (2441d89f-144e-4c54-8c12-708e49ee9aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-719758f5-add9-4467-968c-64bc17b739bf tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created volume successfully. Sep 07 16:59:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-0fb7c002-4901-4253-9986-3fc4b2b94b27-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-0fb7c002-4901-4253-9986-3fc4b2b94b27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-quobyte-0fb7c002-4901-4253-9986-3fc4b2b94b27" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-0fb7c002-4901-4253-9986-3fc4b2b94b27" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:29 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe670808-9198-40af-89fa-7c8581ffb7a3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:29 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 Sep 07 16:59:29 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:30 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27" returned: 0 in 0.393s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:30 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27 Sep 07 16:59:30 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:30 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-0fb7c002-4901-4253-9986-3fc4b2b94b27" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-0fb7c002-4901-4253-9986-3fc4b2b94b27" released by "delete_volume" :: held 0.732s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created reservations ['03c70cc7-b615-4f1c-8b6c-3790ecfd93d6', '66471597-51e2-477c-9417-7cf43850b316', 'f99af3f1-5085-4201-a78a-747c9f074993', '1d550497-67ba-449b-b3c1-edceac4e64a6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:30 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:30 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:30 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-1cf30e6a-0625-4808-9070-1ed3598133fd-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.284s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:30 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Deleted volume successfully. Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-1cf30e6a-0625-4808-9070-1ed3598133fd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-11a11a29-3bad-4c58-a6c3-21ca2308d4d2 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-0fb7c002-4901-4253-9986-3fc4b2b94b27-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-quobyte-1cf30e6a-0625-4808-9070-1ed3598133fd" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-1cf30e6a-0625-4808-9070-1ed3598133fd" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaf6b8f-2ba4-4cf2-95a3-1db111661641]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:31 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd Sep 07 16:59:31 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:31 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd" returned: 0 in 0.351s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:31 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd Sep 07 16:59:31 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:31 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1cf30e6a-0625-4808-9070-1ed3598133fd" returned: 0 in 0.277s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-1cf30e6a-0625-4808-9070-1ed3598133fd" released by "delete_volume" :: held 0.666s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created reservations ['0fa96d93-9874-4f0d-8892-3dc0fa5ee769', 'a04f7583-8a15-454e-b158-3808a49435ad', '5f1bb01d-add4-4b89-b4e3-f94da696ab5f', '0e9910f3-d4c8-4a3f-b031-36bf79e78088'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:31 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:31 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:32 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.244s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Deleted volume successfully. Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-046c2b1a-f6e6-4b31-9981-453fdda12eb0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-1cf30e6a-0625-4808-9070-1ed3598133fd-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-3feca14f-c4e2-4dae-a823-cafdb568c821-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-3feca14f-c4e2-4dae-a823-cafdb568c821-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-quobyte-3feca14f-c4e2-4dae-a823-cafdb568c821" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-3feca14f-c4e2-4dae-a823-cafdb568c821" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[08473800-fddb-4401-9c86-70b58c13d4b6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:32 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 Sep 07 16:59:32 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:32 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821" returned: 0 in 0.361s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:32 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821 Sep 07 16:59:32 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:32 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3feca14f-c4e2-4dae-a823-cafdb568c821" returned: 0 in 0.272s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-3feca14f-c4e2-4dae-a823-cafdb568c821" released by "delete_volume" :: held 0.668s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created reservations ['fed21575-68c1-413f-8116-e86ca2201680', '97412f47-d1f8-474e-ab77-74457bcff9e8', '6a354527-d67f-4532-9100-266e30042e2c', '624deb50-f2d0-48d9-ac5e-5897f5a8b58c'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:33 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:33 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:33 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Deleted volume successfully. Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-c59d94e9-5447-435c-bba8-0c342fa3286b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-3feca14f-c4e2-4dae-a823-cafdb568c821-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-quobyte-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62ab64d-60cf-48c4-bbea-a3846ed3fed6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:33 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:33 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:33 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 Sep 07 16:59:33 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:33 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:59:33 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922" returned: 0 in 0.384s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:33 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922 Sep 07 16:59:33 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:34 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922" returned: 0 in 0.237s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922" released by "delete_volume" :: held 0.658s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created reservations ['2a6454ee-8372-42ce-ae70-ce04088adea4', '98e78a99-715e-4c08-9105-dd40117b7352', 'd8a007ab-dc70-4c25-8e7a-e7107c64ffec', 'e4e5a0e3-15e1-454f-a236-33eafedca235'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:34 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:34 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:34 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.261s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Deleted volume successfully. Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-eda38534-7aac-407c-b150-d69548142e0b tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-3bb6fa75-4a5c-4430-93e1-34c7b1cb3922-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-fbd5920d-8d7b-4812-b1af-c06c43f260e3-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-fbd5920d-8d7b-4812-b1af-c06c43f260e3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-quobyte-fbd5920d-8d7b-4812-b1af-c06c43f260e3" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-fbd5920d-8d7b-4812-b1af-c06c43f260e3" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8423f14-3f9b-4de9-bc87-041dc5b4e05a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:34 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 Sep 07 16:59:34 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:35 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:35 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3 Sep 07 16:59:35 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:35 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fbd5920d-8d7b-4812-b1af-c06c43f260e3" returned: 0 in 0.229s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-fbd5920d-8d7b-4812-b1af-c06c43f260e3" released by "delete_volume" :: held 0.600s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created reservations ['904bcc93-1e73-4cc1-beac-848aa27b3187', 'e241656a-1d55-4293-a4bc-87991592182f', '834f27b9-aa3e-4331-a94d-73efa3b7b042', '7babeca6-2ea2-4589-8e46-51eb2d5a3a2b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:35 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:35 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:35 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.241s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:35 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Deleted volume successfully. Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d62425c6-dec5-4541-961c-585e54c19626 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-fbd5920d-8d7b-4812-b1af-c06c43f260e3-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-389adc21-1746-4967-b570-ad96a6067212-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-389adc21-1746-4967-b570-ad96a6067212-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "cinder-quobyte-389adc21-1746-4967-b570-ad96a6067212" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-389adc21-1746-4967-b570-ad96a6067212" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc7009e-1a84-4920-bc6a-2e6c965ab631]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:35 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 Sep 07 16:59:35 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:36 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212" returned: 0 in 0.370s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:36 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212 Sep 07 16:59:36 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:36 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-389adc21-1746-4967-b570-ad96a6067212" returned: 0 in 0.278s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-quobyte-389adc21-1746-4967-b570-ad96a6067212" released by "delete_volume" :: held 0.689s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Created reservations ['a29c19d6-9b06-4423-89ad-33d78347f819', '32403d7d-c1fd-4a5d-a6c5-d0fbd31e58f8', 'fb8ab3b3-6f11-4a05-b576-df79fc355271', 'b946c11b-b2a0-441a-8c2b-f191e7554ed6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:36 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:36 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:36 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.238s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Deleted volume successfully. Sep 07 16:59:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-89a38dbe-52b1-4de4-ba18-2792708576c0 tempest-CreateVolumesFromSourceVolumeTest-843498939 None] Lock "cinder-389adc21-1746-4967-b570-ad96a6067212-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Flow 'volume_create_manager' (edd9b933-252d-4f73-8fc2-d38ee9fd0814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1902c3f5-26e9-4f5a-99f0-fc64294eed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1902c3f5-26e9-4f5a-99f0-fc64294eed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde7ea06-77e0-4c17-a864-b92d40e50ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642362355c344847b953d47f6a2829fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:42Z,use_quota=True,user_id='4594fffe7a1d4912b4152342359690bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dbd3f3-6c36-48c8-bfbd-51ef7d9bda67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dbd3f3-6c36-48c8-bfbd-51ef7d9bda67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860b4e1c-e4e8-44dd-a8e0-17ab0a8c1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:41 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860b4e1c-e4e8-44dd-a8e0-17ab0a8c1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cde7ea06-77e0-4c17-a864-b92d40e50ec7', 'volume_name': 'volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7', 'volume_size': 1, 'image_id': '4fd54ae9-20f5-4891-8a66-e718b9413557', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fd54ae9-20f5-4891-8a66-e718b9413557', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '805b182e98c698f65d7015195249f22e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '642362355c344847b953d47f6a2829fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c19a2e121afd90dcb499240af16e6d12d56fd16b7b6fbc5974316e11e008c7157f489bba19271f4480547b7187c517ff1fd3082b4bd98de46f2f49ed385aeb18', 'id': '4fd54ae9-20f5-4891-8a66-e718b9413557', 'created_at': datetime.datetime(2026, 9, 7, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 59, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fd54ae9-20f5-4891-8a66-e718b9413557/file', 'properties': {}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791d8bbe-68e8-4142-aa95-282daed5b37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791d8bbe-68e8-4142-aa95-282daed5b37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf48da4-98f7-49d2-bedf-de2902f36e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:42 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Volume cde7ea06-77e0-4c17-a864-b92d40e50ec7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7', 'volume_size': 1, 'image_id': '4fd54ae9-20f5-4891-8a66-e718b9413557', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fd54ae9-20f5-4891-8a66-e718b9413557', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '805b182e98c698f65d7015195249f22e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '642362355c344847b953d47f6a2829fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c19a2e121afd90dcb499240af16e6d12d56fd16b7b6fbc5974316e11e008c7157f489bba19271f4480547b7187c517ff1fd3082b4bd98de46f2f49ed385aeb18', 'id': '4fd54ae9-20f5-4891-8a66-e718b9413557', 'created_at': datetime.datetime(2026, 9, 7, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 59, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fd54ae9-20f5-4891-8a66-e718b9413557/file', 'properties': {}}, 'image_service': } Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Trying to clone cde7ea06-77e0-4c17-a864-b92d40e50ec7 from image 4fd54ae9-20f5-4891-8a66-e718b9413557 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4fd54ae9-20f5-4891-8a66-e718b9413557', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:59:42 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Image download 0.00 MB at 0.00 MB/s Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ec845d-be4d-4c1e-8763-b0c33bc34679]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:42 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD Sep 07 16:59:42 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:42 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:42 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD Sep 07 16:59:42 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:43 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Temporary image 4fd54ae9-20f5-4891-8a66-e718b9413557 is fetched for user 4594fffe7a1d4912b4152342359690bf. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a508254-7d05-4aa1-a268-b70224f26491]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:43 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD Sep 07 16:59:43 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:43 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:43 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD Sep 07 16:59:43 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:43 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde7ea06-77e0-4c17-a864-b92d40e50ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642362355c344847b953d47f6a2829fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:59:42Z,use_quota=True,user_id='4594fffe7a1d4912b4152342359690bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Creating volume cde7ea06-77e0-4c17-a864-b92d40e50ec7 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:59:43 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 16:59:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:43 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 1073741824 Sep 07 16:59:43 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:44 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 1073741824" returned: 0 in 0.380s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:44 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 Sep 07 16:59:44 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:44 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7" returned: 0 in 0.230s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] <== create_volume: return (652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Attempting download of 4fd54ae9-20f5-4891-8a66-e718b9413557 ((None, [{'url': 'file:///opt/stack/data/glance/images/4fd54ae9-20f5-4891-8a66-e718b9413557', 'metadata': {}}])) to volume cde7ea06-77e0-4c17-a864-b92d40e50ec7. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acabb03-2c4b-42cb-bc3c-48e276e5de5d]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fd54ae9-20f5-4891-8a66-e718b9413557_2rq9mxw7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:44 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fd54ae9-20f5-4891-8a66-e718b9413557_2rq9mxw7 Sep 07 16:59:44 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:44 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fd54ae9-20f5-4891-8a66-e718b9413557_2rq9mxw7" returned: 0 in 0.307s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fd54ae9-20f5-4891-8a66-e718b9413557_2rq9mxw7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:44 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fd54ae9-20f5-4891-8a66-e718b9413557_2rq9mxw7 Sep 07 16:59:44 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:45 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fd54ae9-20f5-4891-8a66-e718b9413557_2rq9mxw7" returned: 1 in 0.339s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fd54ae9-20f5-4891-8a66-e718b9413557_2rq9mxw7' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feec5ad-e64c-4501-a413-f4b0111276fe]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:45 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD Sep 07 16:59:45 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:45 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:45 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD Sep 07 16:59:45 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:45 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] 4fd54ae9-20f5-4891-8a66-e718b9413557 was raw, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:59:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:45 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 Sep 07 16:59:45 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:46 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7" returned: 0 in 0.412s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4fd54ae9-20f5-4891-8a66-e718b9413557_fi1iq5msdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:59:46 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:46 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 1G Sep 07 16:59:46 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:46 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 1G" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Downloaded image 4fd54ae9-20f5-4891-8a66-e718b9413557 ((None, [{'url': 'file:///opt/stack/data/glance/images/4fd54ae9-20f5-4891-8a66-e718b9413557', 'metadata': {}}])) to volume cde7ea06-77e0-4c17-a864-b92d40e50ec7 successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Temporary image 4fd54ae9-20f5-4891-8a66-e718b9413557 for user 4594fffe7a1d4912b4152342359690bf is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Marking volume cde7ea06-77e0-4c17-a864-b92d40e50ec7 as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Copying metadata from image 4fd54ae9-20f5-4891-8a66-e718b9413557 to cde7ea06-77e0-4c17-a864-b92d40e50ec7. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Creating volume glance metadata for volume cde7ea06-77e0-4c17-a864-b92d40e50ec7 backed by image 4fd54ae9-20f5-4891-8a66-e718b9413557 with: {'image_id': '4fd54ae9-20f5-4891-8a66-e718b9413557', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '805b182e98c698f65d7015195249f22e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf48da4-98f7-49d2-bedf-de2902f36e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7', 'volume_size': 1, 'image_id': '4fd54ae9-20f5-4891-8a66-e718b9413557', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fd54ae9-20f5-4891-8a66-e718b9413557', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '805b182e98c698f65d7015195249f22e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '642362355c344847b953d47f6a2829fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c19a2e121afd90dcb499240af16e6d12d56fd16b7b6fbc5974316e11e008c7157f489bba19271f4480547b7187c517ff1fd3082b4bd98de46f2f49ed385aeb18', 'id': '4fd54ae9-20f5-4891-8a66-e718b9413557', 'created_at': datetime.datetime(2026, 9, 7, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 59, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fd54ae9-20f5-4891-8a66-e718b9413557/file', 'properties': {}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b26fdd-5a0f-466a-9f9f-c308edc032c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:59:46 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Volume volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 (cde7ea06-77e0-4c17-a864-b92d40e50ec7): created successfully Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b26fdd-5a0f-466a-9f9f-c308edc032c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:59:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Flow 'volume_create_manager' (edd9b933-252d-4f73-8fc2-d38ee9fd0814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:59:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-72184e76-5b75-41c1-bc07-3bb4771d1006 tempest-VolumeImageDependencyTests-484116312 None] Created volume successfully. Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Acquiring lock "cinder-cde7ea06-77e0-4c17-a864-b92d40e50ec7-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Lock "cinder-cde7ea06-77e0-4c17-a864-b92d40e50ec7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Acquiring lock "cinder-quobyte-cde7ea06-77e0-4c17-a864-b92d40e50ec7" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Lock "cinder-quobyte-cde7ea06-77e0-4c17-a864-b92d40e50ec7" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[667b5063-310b-439b-a4f8-37714ba396c0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:47 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 Sep 07 16:59:47 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:47 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7" returned: 0 in 0.363s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:47 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7 Sep 07 16:59:47 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:47 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cde7ea06-77e0-4c17-a864-b92d40e50ec7" returned: 0 in 0.265s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Lock "cinder-quobyte-cde7ea06-77e0-4c17-a864-b92d40e50ec7" released by "delete_volume" :: held 0.666s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Created reservations ['7d664fa5-d9fd-4126-96ff-68f8f98a9226', '95120892-6b51-432e-9099-98d03a811321', '1f4dda7f-b6a6-4c5d-8230-de3e273f8b7d', '7fde1312-f988-47c6-905e-d2800a5949e7'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:48 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 16:59:48 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:48 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.271s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Deleted volume successfully. Sep 07 16:59:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ca01ecc9-2810-43c0-8a05-d04b494cc6f1 tempest-VolumeImageDependencyTests-484116312 None] Lock "cinder-cde7ea06-77e0-4c17-a864-b92d40e50ec7-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=50,cinder:UPDATE=84,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:00:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=60,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=22 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Flow 'volume_create_manager' (36c063e9-e312-4131-819d-941755f7a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42120370-108f-4f73-b59e-81d2377f2b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42120370-108f-4f73-b59e-81d2377f2b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1591912107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36466d47-aab7-4195-b19c-1de712e5309b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b986f262754dcfb9944d3199f01b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:14Z,use_quota=True,user_id='906ee1ff54574643af437d5cbd54f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e98fc5-0f0e-4f11-99ab-6ffce6d55ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e98fc5-0f0e-4f11-99ab-6ffce6d55ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd848a3e-9838-48d2-8a51-3e084597c500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd848a3e-9838-48d2-8a51-3e084597c500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36466d47-aab7-4195-b19c-1de712e5309b', 'volume_name': 'volume-36466d47-aab7-4195-b19c-1de712e5309b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97dca17-651c-4362-b041-dbeb0e1770ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97dca17-651c-4362-b041-dbeb0e1770ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975e7d94-c179-472a-9dac-82a0dc67caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Volume 36466d47-aab7-4195-b19c-1de712e5309b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36466d47-aab7-4195-b19c-1de712e5309b', 'volume_size': 1} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1591912107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36466d47-aab7-4195-b19c-1de712e5309b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b986f262754dcfb9944d3199f01b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:14Z,use_quota=True,user_id='906ee1ff54574643af437d5cbd54f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Creating volume 36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:13 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:13 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b 1073741824 Sep 07 17:00:13 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:14 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b 1073741824" returned: 0 in 0.397s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:14 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b Sep 07 17:00:14 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:14 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b" returned: 0 in 0.231s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975e7d94-c179-472a-9dac-82a0dc67caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36466d47-aab7-4195-b19c-1de712e5309b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4618c3a6-4b44-4ef4-b378-105cb7ad7a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Volume volume-36466d47-aab7-4195-b19c-1de712e5309b (36466d47-aab7-4195-b19c-1de712e5309b): created successfully Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4618c3a6-4b44-4ef4-b378-105cb7ad7a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Flow 'volume_create_manager' (36c063e9-e312-4131-819d-941755f7a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:14 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9456a63c-6305-46b8-833e-f0b47d863e07 tempest-SnapshotDependencyTests-112297331 None] Created volume successfully. Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Creating offline snapshot 420ace27-1baf-455f-8355-65835a9da115 of volume 36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50aacbb-edde-4aea-aa5d-35d176fabc24]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:15 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b Sep 07 17:00:15 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:15 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b" returned: 0 in 0.350s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:15 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 1G Sep 07 17:00:15 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:15 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 1G" returned: 0 in 0.377s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36466d47-aab7-4195-b19c-1de712e5309b -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:15 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36466d47-aab7-4195-b19c-1de712e5309b -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 Sep 07 17:00:15 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:16 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36466d47-aab7-4195-b19c-1de712e5309b -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115" returned: 0 in 0.286s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:16 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 is being set with open permissions: ugo+rw Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:16 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 Sep 07 17:00:16 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:16 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115" returned: 0 in 0.236s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:16 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.info Sep 07 17:00:16 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:16 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.info" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:16 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.info is being set with open permissions: ugo+rw Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:16 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.info Sep 07 17:00:16 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:16 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.info" returned: 0 in 0.239s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b3cd2306-de24-471b-a7e2-7422e5d19c95 tempest-SnapshotDependencyTests-112297331 None] Create snapshot completed successfully Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Flow 'volume_create_manager' (2cf27a5a-87b1-4e6d-a17a-e774a07ff529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b43a066-9a07-45af-825c-877892327824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b43a066-9a07-45af-825c-877892327824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daef0c7-0a14-468d-90ec-f0ff403998ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53b986f262754dcfb9944d3199f01b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=420ace27-1baf-455f-8355-65835a9da115,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:18Z,use_quota=True,user_id='906ee1ff54574643af437d5cbd54f329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a443584-6225-40a5-af91-6fecc6c72a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a443584-6225-40a5-af91-6fecc6c72a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255aecb0-30b6-4055-9ac3-3ac8095d945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255aecb0-30b6-4055-9ac3-3ac8095d945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7daef0c7-0a14-468d-90ec-f0ff403998ee', 'volume_name': 'volume-7daef0c7-0a14-468d-90ec-f0ff403998ee', 'volume_size': 1, 'snapshot_id': '420ace27-1baf-455f-8355-65835a9da115'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1351c68c-cbef-440e-9083-eb88ad35b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1351c68c-cbef-440e-9083-eb88ad35b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f64caf1-9d31-4c6a-9ca5-d1643746f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Volume 7daef0c7-0a14-468d-90ec-f0ff403998ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7daef0c7-0a14-468d-90ec-f0ff403998ee', 'volume_size': 1, 'snapshot_id': '420ace27-1baf-455f-8355-65835a9da115'} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-quobyte-420ace27-1baf-455f-8355-65835a9da115-7daef0c7-0a14-468d-90ec-f0ff403998ee" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-420ace27-1baf-455f-8355-65835a9da115-7daef0c7-0a14-468d-90ec-f0ff403998ee" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Creating volume 7daef0c7-0a14-468d-90ec-f0ff403998ee from snapshot 420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-quobyte-7daef0c7-0a14-468d-90ec-f0ff403998ee" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-7daef0c7-0a14-468d-90ec-f0ff403998ee" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] snapshot: 420ace27-1baf-455f-8355-65835a9da115, volume: 7daef0c7-0a14-468d-90ec-f0ff403998ee, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e20e817-642f-41d2-9741-e09e4941d274]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:17 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 Sep 07 17:00:17 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:18 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115" returned: 0 in 0.341s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36466d47-aab7-4195-b19c-1de712e5309b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c5079a-1097-4643-98bf-10071854ae02]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:18 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b Sep 07 17:00:18 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:18 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b" returned: 0 in 0.342s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:00:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:18 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee Sep 07 17:00:18 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:22 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee" returned: 0 in 3.925s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b, size 1024.00 MB, duration 3.93 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:00:22 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Converted 1024.00 MB image at 260.81 MB/s Sep 07 17:00:22 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee is being set with open permissions: ugo+rw Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:22 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee Sep 07 17:00:22 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:22 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-7daef0c7-0a14-468d-90ec-f0ff403998ee" released by "_copy_volume_from_snapshot" :: held 4.926s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-420ace27-1baf-455f-8355-65835a9da115-7daef0c7-0a14-468d-90ec-f0ff403998ee" released by "_create_volume_from_snapshot" :: held 4.989s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f64caf1-9d31-4c6a-9ca5-d1643746f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7daef0c7-0a14-468d-90ec-f0ff403998ee', 'volume_size': 1, 'snapshot_id': '420ace27-1baf-455f-8355-65835a9da115'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14d9651-9e79-4fa7-8f55-79bb7e177682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Volume volume-7daef0c7-0a14-468d-90ec-f0ff403998ee (7daef0c7-0a14-468d-90ec-f0ff403998ee): created successfully Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14d9651-9e79-4fa7-8f55-79bb7e177682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Flow 'volume_create_manager' (2cf27a5a-87b1-4e6d-a17a-e774a07ff529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:22 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-598a9529-eacf-4f5f-a549-664b4fb7161f tempest-SnapshotDependencyTests-112297331 None] Created volume successfully. Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-420ace27-1baf-455f-8355-65835a9da115-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-420ace27-1baf-455f-8355-65835a9da115-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-quobyte-36466d47-aab7-4195-b19c-1de712e5309b" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-36466d47-aab7-4195-b19c-1de712e5309b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-quobyte-420ace27-1baf-455f-8355-65835a9da115" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-420ace27-1baf-455f-8355-65835a9da115" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Deleting offline snapshot 420ace27-1baf-455f-8355-65835a9da115 of volume 36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] snapshot_file for this snap is: volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[89edefc7-6a43-426b-b11f-6bf740f4be2b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:23 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 Sep 07 17:00:23 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:23 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115" returned: 0 in 0.350s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36466d47-aab7-4195-b19c-1de712e5309b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e6a26-b336-4cc4-a401-7c3e54de85c3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:23 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b Sep 07 17:00:23 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:24 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b" returned: 0 in 0.500s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:24 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 Sep 07 17:00:24 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:24 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115" returned: 0 in 0.338s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:24 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115 Sep 07 17:00:24 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:24 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b.420ace27-1baf-455f-8355-65835a9da115" returned: 0 in 0.247s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-420ace27-1baf-455f-8355-65835a9da115" released by "_delete_snapshot" :: held 1.529s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-36466d47-aab7-4195-b19c-1de712e5309b" released by "delete_snapshot" :: held 1.555s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Created reservations ['a0012a47-090e-44eb-a51a-090de9ad4df6', 'a82d5780-d171-499e-b23a-c0d56ea8ba5e', '10d5fd36-ad1c-4ba8-bc95-bee2bf453c64', 'e05fc6e5-bc2e-4d0e-bf0f-d2da1557793f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:24 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Delete snapshot completed successfully. Sep 07 17:00:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-608ecd40-1765-4231-9095-c9e679b79ad9 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-420ace27-1baf-455f-8355-65835a9da115-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-36466d47-aab7-4195-b19c-1de712e5309b-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-36466d47-aab7-4195-b19c-1de712e5309b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-quobyte-36466d47-aab7-4195-b19c-1de712e5309b" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-36466d47-aab7-4195-b19c-1de712e5309b" acquired by "delete_volume" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b89de-8e9c-4ea3-b12e-9efc8c8861ae]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:25 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b Sep 07 17:00:25 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:25 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b" returned: 0 in 0.338s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:25 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b Sep 07 17:00:25 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:26 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-36466d47-aab7-4195-b19c-1de712e5309b" returned: 0 in 0.227s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-36466d47-aab7-4195-b19c-1de712e5309b" released by "delete_volume" :: held 0.614s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Created reservations ['cd3721ac-f014-4d86-899d-7ff4d865a4a3', '2c3ccb41-35d4-4208-896f-f5b9a6f36b96', '35ffe4fd-2b07-4a35-b6f1-f29bc6a774f2', '5fbf3e42-ec60-4a38-86dc-918c6d9d5426'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:26 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:00:26 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:26 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.233s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Deleted volume successfully. Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7dd53fc2-984a-458e-9126-84215460d820 tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-36466d47-aab7-4195-b19c-1de712e5309b-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-7daef0c7-0a14-468d-90ec-f0ff403998ee-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-7daef0c7-0a14-468d-90ec-f0ff403998ee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "cinder-quobyte-7daef0c7-0a14-468d-90ec-f0ff403998ee" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-7daef0c7-0a14-468d-90ec-f0ff403998ee" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f805f0-28e8-4148-a0c0-056c91150254]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:26 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee Sep 07 17:00:26 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:26 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee" returned: 0 in 0.348s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:26 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee Sep 07 17:00:26 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:27 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7daef0c7-0a14-468d-90ec-f0ff403998ee" returned: 0 in 0.234s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-quobyte-7daef0c7-0a14-468d-90ec-f0ff403998ee" released by "delete_volume" :: held 0.621s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Created reservations ['75885406-97e5-495e-99ec-574329ca39e6', '2fd36c22-c7d7-44f9-bf4d-25225aa7c75b', 'da26645f-26fc-4bba-b670-a12fd1dc724f', '7e142d29-96a6-4bb1-82a7-ca37d1926587'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:27 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:00:27 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:27 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.247s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Deleted volume successfully. Sep 07 17:00:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cdf8c861-3a2a-462b-9ad4-8c415d6ce82e tempest-SnapshotDependencyTests-112297331 None] Lock "cinder-7daef0c7-0a14-468d-90ec-f0ff403998ee-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:33 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:00:33 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:33 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:00:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:00:37 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=30,cinder:SELECT=28,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:00:37 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=21,cinder:UPDATE=28,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (0e065254-894c-41f9-b0a4-179e646c3691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f208a77-acfb-4139-b586-3db2ea7632c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f208a77-acfb-4139-b586-3db2ea7632c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228648729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:49Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ab8c46-3577-4d2c-abe2-d32e7cc41afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ab8c46-3577-4d2c-abe2-d32e7cc41afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60189ee-e25f-4609-b88b-792d35d39928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60189ee-e25f-4609-b88b-792d35d39928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3', 'volume_name': 'volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c17d7df-a63f-440a-be28-35761ff3a387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c17d7df-a63f-440a-be28-35761ff3a387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27483d8-2802-4803-9fd1-fd7443f56994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:48 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume 1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3', 'volume_size': 1} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228648729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:49Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Creating volume 1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:49 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:49 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 1073741824 Sep 07 17:00:49 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (7f4942a2-2fb3-4f52-b7f9-da96e423fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93206870-3905-406a-aad7-35dec234142c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93206870-3905-406a-aad7-35dec234142c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1558180005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9bc7d5-0e92-443b-a896-a1d1c38cab55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:49Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42519c3-348d-4ad5-8610-40b9623c5a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42519c3-348d-4ad5-8610-40b9623c5a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19958082-4502-4ac2-8ccd-d6ae47c3f5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19958082-4502-4ac2-8ccd-d6ae47c3f5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9bc7d5-0e92-443b-a896-a1d1c38cab55', 'volume_name': 'volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1362dabf-1b48-491e-a7a4-39c05d86ab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1362dabf-1b48-491e-a7a4-39c05d86ab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d87136-1d0f-4716-876c-932fb4f75d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:49 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Volume 2d9bc7d5-0e92-443b-a896-a1d1c38cab55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55', 'volume_size': 1} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:49 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 1073741824" returned: 0 in 0.640s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:49 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 Sep 07 17:00:49 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (c1c47b68-08ca-4f27-84f7-b39d9cf1e419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:49 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39e96a6-d15d-472f-aea0-0261a032aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39e96a6-d15d-472f-aea0-0261a032aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1729850248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753b86a2-05ec-4fa8-a567-c6e286e463b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:50Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5678d398-0375-4bf0-af28-c3fe62d9e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5678d398-0375-4bf0-af28-c3fe62d9e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bebc27-c409-414e-8a36-2f7e8816fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24bebc27-c409-414e-8a36-2f7e8816fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753b86a2-05ec-4fa8-a567-c6e286e463b9', 'volume_name': 'volume-753b86a2-05ec-4fa8-a567-c6e286e463b9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d101ce6-c2ce-4b3e-9ce0-58316c7456db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d101ce6-c2ce-4b3e-9ce0-58316c7456db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0af098-2abe-4040-802c-c7461bfbcd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Volume 753b86a2-05ec-4fa8-a567-c6e286e463b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753b86a2-05ec-4fa8-a567-c6e286e463b9', 'volume_size': 1} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" returned: 0 in 0.443s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1558180005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9bc7d5-0e92-443b-a896-a1d1c38cab55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:49Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Creating volume 2d9bc7d5-0e92-443b-a896-a1d1c38cab55 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:50 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27483d8-2802-4803-9fd1-fd7443f56994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 1073741824 Sep 07 17:00:50 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e1483e-1a74-4d53-95c3-98c26c83226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 (1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3): created successfully Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e1483e-1a74-4d53-95c3-98c26c83226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (0e065254-894c-41f9-b0a4-179e646c3691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b2719dcd-b424-4569-a444-963d8dd8b266 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created volume successfully. Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (1f873d32-6178-4b50-b9dd-988c4e42718f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effefe3a-f0bd-43b4-8d33-b792f9daa642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effefe3a-f0bd-43b4-8d33-b792f9daa642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205620458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804f4372-caaf-4a50-bdb1-8e4c6346cc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:50Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8048d0-b77b-44d4-9cef-54c1b9be00bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8048d0-b77b-44d4-9cef-54c1b9be00bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c397b55f-2422-46e0-9bc3-636108e3a175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c397b55f-2422-46e0-9bc3-636108e3a175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '804f4372-caaf-4a50-bdb1-8e4c6346cc84', 'volume_name': 'volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9a9519-6ee0-4d62-9c4c-3d6d94bd65b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9a9519-6ee0-4d62-9c4c-3d6d94bd65b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c947d0f6-dd41-4e28-944d-9b3df39a34e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Volume 804f4372-caaf-4a50-bdb1-8e4c6346cc84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84', 'volume_size': 1} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (3364259c-519e-4f9c-9382-548adf1224f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edfca4a-7d0a-4c51-adaf-7c07c2125a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edfca4a-7d0a-4c51-adaf-7c07c2125a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548511322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce64acf3-036c-4635-9e82-aee67077323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:51Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156fbebe-4f26-4825-a314-ca1ca72ea2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156fbebe-4f26-4825-a314-ca1ca72ea2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecf2ef5-1895-4b3a-b771-ee9fe2c08311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fecf2ef5-1895-4b3a-b771-ee9fe2c08311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce64acf3-036c-4635-9e82-aee67077323a', 'volume_name': 'volume-ce64acf3-036c-4635-9e82-aee67077323a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818db929-ff82-4fb9-afe5-4b65def0a4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818db929-ff82-4fb9-afe5-4b65def0a4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9555379a-e05a-4198-8414-7f576ff16c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Volume ce64acf3-036c-4635-9e82-aee67077323a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce64acf3-036c-4635-9e82-aee67077323a', 'volume_size': 1} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:50 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 1073741824" returned: 0 in 0.747s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:51 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 Sep 07 17:00:51 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (17f49a51-3223-46e6-8fb8-8163b7f9a1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ea9b49-768b-4a4f-92d7-7669085619b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ea9b49-768b-4a4f-92d7-7669085619b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037419030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710c90ed-ee52-427e-b8f1-970cea1b9712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:51Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f635beb-3aca-4a15-a720-f6f9739b2843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f635beb-3aca-4a15-a720-f6f9739b2843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65295d68-fafa-4140-aed3-e0f916f21868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65295d68-fafa-4140-aed3-e0f916f21868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710c90ed-ee52-427e-b8f1-970cea1b9712', 'volume_name': 'volume-710c90ed-ee52-427e-b8f1-970cea1b9712', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86407504-e295-4866-b6f3-15f429f79d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86407504-e295-4866-b6f3-15f429f79d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f972410-4b47-4e62-b452-48e2244652b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Volume 710c90ed-ee52-427e-b8f1-970cea1b9712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710c90ed-ee52-427e-b8f1-970cea1b9712', 'volume_size': 1} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:51 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55" returned: 0 in 0.390s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.227s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1729850248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753b86a2-05ec-4fa8-a567-c6e286e463b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:50Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Creating volume 753b86a2-05ec-4fa8-a567-c6e286e463b9 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:51 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d87136-1d0f-4716-876c-932fb4f75d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2eab66-42c8-42f4-b6ac-a23555d16464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 1073741824 Sep 07 17:00:51 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:51 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Volume volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 (2d9bc7d5-0e92-443b-a896-a1d1c38cab55): created successfully Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2eab66-42c8-42f4-b6ac-a23555d16464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (7f4942a2-2fb3-4f52-b7f9-da96e423fee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-faf1d2c3-f89a-468f-a79f-85543ce21d6d tempest-CreateVolumesFromImageTest-821366893 None] Created volume successfully. Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (69cc5af4-0f3a-4d38-9bb3-fc5d74c0708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df03afc6-90e5-4ac1-a405-e4ac26c66670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df03afc6-90e5-4ac1-a405-e4ac26c66670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078968189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee55bff-0df7-4970-9ec2-fbaa2fddee80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:52Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07feb12-20a6-4757-b024-4130e1a7677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e07feb12-20a6-4757-b024-4130e1a7677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac74eeaa-362d-4dfd-b379-c9f5d1f44047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac74eeaa-362d-4dfd-b379-c9f5d1f44047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee55bff-0df7-4970-9ec2-fbaa2fddee80', 'volume_name': 'volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce28e9a-0de4-4238-b01e-f2c40ad24e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce28e9a-0de4-4238-b01e-f2c40ad24e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47c6efd-8774-4371-a48c-4bc0d4d5d516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:51 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Volume 8ee55bff-0df7-4970-9ec2-fbaa2fddee80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80', 'volume_size': 1} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:51 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 1073741824" returned: 0 in 0.520s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:51 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 Sep 07 17:00:51 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:52 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9" returned: 0 in 0.261s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.704s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-205620458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=804f4372-caaf-4a50-bdb1-8e4c6346cc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:50Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Creating volume 804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:52 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0af098-2abe-4040-802c-c7461bfbcd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753b86a2-05ec-4fa8-a567-c6e286e463b9', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:52 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 1073741824 Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f49ede-327f-4949-a09b-7d8a97bc2471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:52 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:52 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Volume volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 (753b86a2-05ec-4fa8-a567-c6e286e463b9): created successfully Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f49ede-327f-4949-a09b-7d8a97bc2471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (c1c47b68-08ca-4f27-84f7-b39d9cf1e419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e3b38fd5-faa5-4aeb-924d-289750b32624 tempest-CreateVolumesFromImageTest-821366893 None] Created volume successfully. Sep 07 17:00:52 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 1073741824" returned: 0 in 0.507s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:52 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 Sep 07 17:00:52 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:53 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84" returned: 0 in 0.292s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.252s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548511322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce64acf3-036c-4635-9e82-aee67077323a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:51Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Creating volume ce64acf3-036c-4635-9e82-aee67077323a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:53 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c947d0f6-dd41-4e28-944d-9b3df39a34e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:53 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a 1073741824 Sep 07 17:00:53 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b1aeae-1a3b-49c5-9787-ee656c64067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Volume volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 (804f4372-caaf-4a50-bdb1-8e4c6346cc84): created successfully Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b1aeae-1a3b-49c5-9787-ee656c64067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (1f873d32-6178-4b50-b9dd-988c4e42718f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9c1ff6eb-0216-482a-82f4-657eff472dc1 tempest-ProjectReaderTests-633524117 None] Created volume successfully. Sep 07 17:00:53 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a 1073741824" returned: 0 in 0.563s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:53 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a Sep 07 17:00:53 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:54 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Flow 'volume_create_manager' (28f33f1e-2c71-4585-b222-5d5d91884317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b56aa0-b629-4417-9480-8e3c63e4b940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a" returned: 0 in 0.342s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.886s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037419030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710c90ed-ee52-427e-b8f1-970cea1b9712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:51Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Creating volume 710c90ed-ee52-427e-b8f1-970cea1b9712 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b56aa0-b629-4417-9480-8e3c63e4b940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c3ddbf-3274-4814-9223-91379115d158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af184d7b4ce748fbaa24c4196541d836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:54Z,use_quota=True,user_id='ca30636caf7645138399a30d3e1feca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6af840cf-6c93-40a6-b3e9-442a0d2a0100),volume_type_id=6af840cf-6c93-40a6-b3e9-442a0d2a0100)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 1073741824 Sep 07 17:00:54 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c10fb6-4694-42d3-9b44-ed022c3f6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c10fb6-4694-42d3-9b44-ed022c3f6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcbd688-ce65-4c01-95ae-60f274a8b99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9555379a-e05a-4198-8414-7f576ff16c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce64acf3-036c-4635-9e82-aee67077323a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8045f4d7-161d-4c98-a2e0-4edc522cb296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Volume volume-ce64acf3-036c-4635-9e82-aee67077323a (ce64acf3-036c-4635-9e82-aee67077323a): created successfully Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8045f4d7-161d-4c98-a2e0-4edc522cb296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (3364259c-519e-4f9c-9382-548adf1224f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d9b06c50-3a0b-454b-a3b5-f971cf92f8c5 tempest-CreateVolumesFromImageTest-821366893 None] Created volume successfully. Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcbd688-ce65-4c01-95ae-60f274a8b99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47c3ddbf-3274-4814-9223-91379115d158', 'volume_name': 'volume-47c3ddbf-3274-4814-9223-91379115d158', 'volume_size': 1, 'image_id': '29bf76cd-11d2-45cb-8431-62710b761849', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29bf76cd-11d2-45cb-8431-62710b761849', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44dd6b09befac47a484103ac1bfcb45d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af184d7b4ce748fbaa24c4196541d836', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1c3d9861ba89ab887f49fe05416cb9b57631bb31ffaebb2f57ef4df933e7c3b5b8ca729db4e11957194aa9bb804d9a46664fe79a24dc5d09b7155e6c1bfe44c', 'id': '29bf76cd-11d2-45cb-8431-62710b761849', 'created_at': datetime.datetime(2026, 9, 7, 15, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29bf76cd-11d2-45cb-8431-62710b761849/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04738d0-779c-4203-8978-85f6d93c61a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04738d0-779c-4203-8978-85f6d93c61a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099fd13f-5704-4fcf-9928-e82b71a86fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Volume 47c3ddbf-3274-4814-9223-91379115d158: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47c3ddbf-3274-4814-9223-91379115d158', 'volume_size': 1, 'image_id': '29bf76cd-11d2-45cb-8431-62710b761849', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29bf76cd-11d2-45cb-8431-62710b761849', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44dd6b09befac47a484103ac1bfcb45d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af184d7b4ce748fbaa24c4196541d836', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1c3d9861ba89ab887f49fe05416cb9b57631bb31ffaebb2f57ef4df933e7c3b5b8ca729db4e11957194aa9bb804d9a46664fe79a24dc5d09b7155e6c1bfe44c', 'id': '29bf76cd-11d2-45cb-8431-62710b761849', 'created_at': datetime.datetime(2026, 9, 7, 15, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29bf76cd-11d2-45cb-8431-62710b761849/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Trying to clone 47c3ddbf-3274-4814-9223-91379115d158 from image 29bf76cd-11d2-45cb-8431-62710b761849 at location (None, [{'url': 'file:///opt/stack/data/glance/images/29bf76cd-11d2-45cb-8431-62710b761849', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:00:54 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 1073741824" returned: 0 in 0.502s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Image download 0.00 MB at 0.00 MB/s Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:54 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 Sep 07 17:00:54 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[60629274-ac2e-4aa3-aa0b-1edca2362851]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:54 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD Sep 07 17:00:54 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:54 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712" returned: 0 in 0.289s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.169s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078968189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee55bff-0df7-4970-9ec2-fbaa2fddee80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f974bd79f803474792bc139666d5e8c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:52Z,use_quota=True,user_id='54c4cb61c71e49d1b7d9ae063a6e463e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Creating volume 8ee55bff-0df7-4970-9ec2-fbaa2fddee80 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f972410-4b47-4e62-b452-48e2244652b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710c90ed-ee52-427e-b8f1-970cea1b9712', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 1073741824 Sep 07 17:00:54 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c2267c-141b-44af-9243-cc09c588f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Volume volume-710c90ed-ee52-427e-b8f1-970cea1b9712 (710c90ed-ee52-427e-b8f1-970cea1b9712): created successfully Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c2267c-141b-44af-9243-cc09c588f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:54 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (17f49a51-3223-46e6-8fb8-8163b7f9a1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:54 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c2efb16a-b1cc-4c9b-81e9-e7d00fc9e7a5 tempest-CreateVolumesFromImageTest-821366893 None] Created volume successfully. Sep 07 17:00:55 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:55 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD Sep 07 17:00:55 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:55 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Temporary image 29bf76cd-11d2-45cb-8431-62710b761849 is fetched for user ca30636caf7645138399a30d3e1feca4. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:00:55 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 1073741824" returned: 0 in 0.472s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3949686-6976-4f22-ad93-26d1add3ab1a]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:55 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 Sep 07 17:00:55 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:55 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD Sep 07 17:00:55 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:55 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.939s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Creating offline snapshot 6e76b919-f55e-4db9-a18b-c4bd335b93fc of volume 1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47c6efd-8774-4371-a48c-4bc0d4d5d516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb8e3d4-2514-4f0a-be96-f1a04ec1f2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0252855-0ff6-4613-98a1-a29200acb801]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:55 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Volume volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 (8ee55bff-0df7-4970-9ec2-fbaa2fddee80): created successfully Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb8e3d4-2514-4f0a-be96-f1a04ec1f2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Flow 'volume_create_manager' (69cc5af4-0f3a-4d38-9bb3-fc5d74c0708b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-195e4133-7785-43b6-889a-b15df564684f tempest-CreateVolumesFromImageTest-821366893 None] Created volume successfully. Sep 07 17:00:55 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:55 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 Sep 07 17:00:55 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:55 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD Sep 07 17:00:55 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:56 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-8ee55bff-0df7-4970-9ec2-fbaa2fddee80-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-8ee55bff-0df7-4970-9ec2-fbaa2fddee80-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:56 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" returned: 0 in 0.471s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:56 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc 1G Sep 07 17:00:56 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-quobyte-8ee55bff-0df7-4970-9ec2-fbaa2fddee80" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-8ee55bff-0df7-4970-9ec2-fbaa2fddee80" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7582a263-6a61-4688-b493-b73668c49007]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:56 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 Sep 07 17:00:56 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:56 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc 1G" returned: 0 in 0.448s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:56 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80" returned: 0 in 0.385s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:56 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc Sep 07 17:00:56 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:56 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80 Sep 07 17:00:56 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:56 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-8ee55bff-0df7-4970-9ec2-fbaa2fddee80" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-8ee55bff-0df7-4970-9ec2-fbaa2fddee80" released by "delete_volume" :: held 0.714s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:56 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc" returned: 0 in 0.332s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:56 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc is being set with open permissions: ugo+rw Sep 07 17:00:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:57 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc Sep 07 17:00:57 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Created reservations ['1f993dab-5777-45dc-a45c-237c6421152d', 'db2c337b-45ef-433c-b650-bd75b5c26d54', '8af2e276-039b-4b70-86c0-d3899b5cf8e7', 'c6f75645-56ac-4994-93c1-55ddc5550be1'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:57 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:00:57 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:57 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc" returned: 0 in 0.285s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:57 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.info Sep 07 17:00:57 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-710c90ed-ee52-427e-b8f1-970cea1b9712-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-710c90ed-ee52-427e-b8f1-970cea1b9712-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-quobyte-710c90ed-ee52-427e-b8f1-970cea1b9712" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-710c90ed-ee52-427e-b8f1-970cea1b9712" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[801477da-3402-4845-8f7b-6396b5af44a3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:57 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.322s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Deleted volume successfully. Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ee9b288c-3d49-47b5-9383-8b566601ba96 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-8ee55bff-0df7-4970-9ec2-fbaa2fddee80-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:57 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 Sep 07 17:00:57 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:57 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.info" returned: 0 in 0.341s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:57 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.info is being set with open permissions: ugo+rw Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:57 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.info Sep 07 17:00:57 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:57 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712" returned: 0 in 0.389s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:57 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712 Sep 07 17:00:57 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:57 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.info" returned: 0 in 0.266s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.938s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Creating offline snapshot 0b6be9d4-a4e7-4378-a60a-f9cd53a29544 of volume 804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c1903f-1f67-4a03-860c-2d5511ea9262]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a2352e2f-f5e0-426f-bc23-e82360056ea9 tempest-CreateVolumesFromSnapshotTest-922611610 None] Create snapshot completed successfully Sep 07 17:00:58 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 Sep 07 17:00:58 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:58 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-710c90ed-ee52-427e-b8f1-970cea1b9712" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-710c90ed-ee52-427e-b8f1-970cea1b9712" released by "delete_volume" :: held 0.733s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Created reservations ['52f999ac-2c71-4584-b484-f72aa5189cb4', 'fa22b29e-2a53-4b2e-8f55-6d87766ba92a', '6e9fac9a-4eb2-4c8b-96bd-77c394144094', 'd647ed29-4eb7-4927-87ad-abef2466d3b4'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:58 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:00:58 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:58 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84" returned: 0 in 0.441s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:58 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 1G Sep 07 17:00:58 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-ce64acf3-036c-4635-9e82-aee67077323a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:58 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-ce64acf3-036c-4635-9e82-aee67077323a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Deleted volume successfully. Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (9b925adb-962a-493c-8d6d-d5aa5d447309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bea5ad-0e35-4b8e-9f9a-be57a5dc7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bea5ad-0e35-4b8e-9f9a-be57a5dc7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800753330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb70a00-5183-4c55-b295-cd30600c73d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:59Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d19b3d-4cf3-484a-824b-857cb25fc7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d19b3d-4cf3-484a-824b-857cb25fc7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cccef5-67fe-45ed-8cf6-7dc57f9acb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cccef5-67fe-45ed-8cf6-7dc57f9acb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb70a00-5183-4c55-b295-cd30600c73d1', 'volume_name': 'volume-ecb70a00-5183-4c55-b295-cd30600c73d1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d614079-cb08-4bad-b9fc-285c676cfbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d614079-cb08-4bad-b9fc-285c676cfbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42f0918-0e65-4879-8985-d399038eda5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:58 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume ecb70a00-5183-4c55-b295-cd30600c73d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb70a00-5183-4c55-b295-cd30600c73d1', 'volume_size': 1} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-quobyte-ce64acf3-036c-4635-9e82-aee67077323a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a38b8ead-5e96-4f6f-ad5c-3d239d311897 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-710c90ed-ee52-427e-b8f1-970cea1b9712-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-ce64acf3-036c-4635-9e82-aee67077323a" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[536d6bed-5d87-49ba-acd4-2ed1f11d595b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:59 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a Sep 07 17:00:59 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:59 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 1G" returned: 0 in 0.664s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:59 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 Sep 07 17:00:59 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (78b604e2-3daf-417f-be5a-28d199a27b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4725a853-036f-411d-9ef3-5fb48b2c31ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4725a853-036f-411d-9ef3-5fb48b2c31ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250384258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca7fa0a-b1ba-4369-b58b-995e3165bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:59Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0595f21f-d31a-437f-966f-0d23457c61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0595f21f-d31a-437f-966f-0d23457c61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a289ef16-d5e0-47cb-bf68-52d49bdebcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a289ef16-d5e0-47cb-bf68-52d49bdebcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca7fa0a-b1ba-4369-b58b-995e3165bb7b', 'volume_name': 'volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d6d9fb-bafa-4375-a93e-81c8d697a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d6d9fb-bafa-4375-a93e-81c8d697a0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dc501e-e443-438c-a0a2-787e5f2c856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume fca7fa0a-b1ba-4369-b58b-995e3165bb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b', 'volume_size': 1} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a" returned: 0 in 0.479s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:59 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a Sep 07 17:00:59 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:59 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544" returned: 0 in 0.511s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:59 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 is being set with open permissions: ugo+rw Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:59 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 Sep 07 17:00:59 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (2e62e120-6fbf-4c49-a3b0-fa89dee26b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91cda13-3afe-4811-b4e8-feb53edf1755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c91cda13-3afe-4811-b4e8-feb53edf1755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2045200822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57482018-fff8-4e20-9de6-517208c75048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:00Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07ae379-1301-4131-ab09-d53f424e9fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07ae379-1301-4131-ab09-d53f424e9fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b3c93d-5142-48b5-aa71-ff8b8618f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b3c93d-5142-48b5-aa71-ff8b8618f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57482018-fff8-4e20-9de6-517208c75048', 'volume_name': 'volume-57482018-fff8-4e20-9de6-517208c75048', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff8e7cd-c7bf-41f8-a4fc-143a31947a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff8e7cd-c7bf-41f8-a4fc-143a31947a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60919ec1-e781-4c9e-a385-c5b3abfabdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:59 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume 57482018-fff8-4e20-9de6-517208c75048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57482018-fff8-4e20-9de6-517208c75048', 'volume_size': 1} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ce64acf3-036c-4635-9e82-aee67077323a" returned: 0 in 0.485s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-ce64acf3-036c-4635-9e82-aee67077323a" released by "delete_volume" :: held 1.011s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:59 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544" returned: 0 in 0.325s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:00 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.info Sep 07 17:01:00 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Created reservations ['2f06a513-6dff-4902-8c01-e6017a310209', 'e7006958-6763-491d-9967-ec76774c8c4f', '26e397ca-b390-43d8-8b77-bdb635356a7c', 'fef4d234-3ba0-45be-91d0-61bea885902a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:00 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:00 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (74f4bd74-284c-405d-8411-d6465361b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c3490f-18cf-4e47-8184-9d92351923a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.info" returned: 0 in 0.387s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:00 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.info is being set with open permissions: ugo+rw Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c3490f-18cf-4e47-8184-9d92351923a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205385442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9b16b4-fcae-4ed5-808d-4221fd291531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:00Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e12e56f-cff0-427c-8ca8-3b970e3a3706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.info Sep 07 17:01:00 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e12e56f-cff0-427c-8ca8-3b970e3a3706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6e9c98-0366-441b-962b-3d2f34164391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6e9c98-0366-441b-962b-3d2f34164391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9b16b4-fcae-4ed5-808d-4221fd291531', 'volume_name': 'volume-fb9b16b4-fcae-4ed5-808d-4221fd291531', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3fed82-dafd-4cf6-8f2b-274ff780768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3fed82-dafd-4cf6-8f2b-274ff780768a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8b7b5-67e5-4626-8236-8efddf7a9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume fb9b16b4-fcae-4ed5-808d-4221fd291531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9b16b4-fcae-4ed5-808d-4221fd291531', 'volume_size': 1} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:00 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.331s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Deleted volume successfully. Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7e4be998-a394-4e8e-9cfc-9437f9a40044 tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-ce64acf3-036c-4635-9e82-aee67077323a-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:00 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.info" returned: 0 in 0.298s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.519s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c3ddbf-3274-4814-9223-91379115d158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af184d7b4ce748fbaa24c4196541d836',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:54Z,use_quota=True,user_id='ca30636caf7645138399a30d3e1feca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6af840cf-6c93-40a6-b3e9-442a0d2a0100),volume_type_id=6af840cf-6c93-40a6-b3e9-442a0d2a0100)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Creating volume 47c3ddbf-3274-4814-9223-91379115d158 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:00 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:00 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 1073741824 Sep 07 17:01:00 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e05422ae-ba5b-42a7-b23e-35cf5e4179ae tempest-ProjectReaderTests-633524117 None] Create snapshot completed successfully Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (2541c8d4-ae41-49f1-84f3-ff41e4096002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62beddf-99ce-446e-896b-236bd648f026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62beddf-99ce-446e-896b-236bd648f026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2060487700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f916ae-28c1-44aa-9eab-7b1f16c35911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:01Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245a79a3-9a09-4010-b27e-ff84423fd5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245a79a3-9a09-4010-b27e-ff84423fd5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c440575f-3e20-4c64-9cd0-b7fb4c1e8903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c440575f-3e20-4c64-9cd0-b7fb4c1e8903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f916ae-28c1-44aa-9eab-7b1f16c35911', 'volume_name': 'volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09774af-b45f-47db-bc8e-56c3386ab9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09774af-b45f-47db-bc8e-56c3386ab9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fad1ef0-91fa-4ec6-9b78-376f29ccc7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume f2f916ae-28c1-44aa-9eab-7b1f16c35911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911', 'volume_size': 1} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-753b86a2-05ec-4fa8-a567-c6e286e463b9-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-753b86a2-05ec-4fa8-a567-c6e286e463b9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-quobyte-753b86a2-05ec-4fa8-a567-c6e286e463b9" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-753b86a2-05ec-4fa8-a567-c6e286e463b9" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee0a28a-82fe-4129-8b05-b93d4c32cc35]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 1073741824" returned: 0 in 0.470s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:01 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 Sep 07 17:01:01 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 Sep 07 17:01:01 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:01 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9" returned: 0 in 0.427s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158" returned: 0 in 0.311s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:01 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9 Sep 07 17:01:01 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.674s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800753330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb70a00-5183-4c55-b295-cd30600c73d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:59Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Creating volume ecb70a00-5183-4c55-b295-cd30600c73d1 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:01 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 1073741824 Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Attempting download of 29bf76cd-11d2-45cb-8431-62710b761849 ((None, [{'url': 'file:///opt/stack/data/glance/images/29bf76cd-11d2-45cb-8431-62710b761849', 'metadata': {}}])) to volume 47c3ddbf-3274-4814-9223-91379115d158. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:01:01 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-0b6be9d4-a4e7-4378-a60a-f9cd53a29544-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde5907-31ed-4946-b9dc-caa52e73411d]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29bf76cd-11d2-45cb-8431-62710b761849_61ziz357 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Lock "cinder-0b6be9d4-a4e7-4378-a60a-f9cd53a29544-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-804f4372-caaf-4a50-bdb1-8e4c6346cc84" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-804f4372-caaf-4a50-bdb1-8e4c6346cc84" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-0b6be9d4-a4e7-4378-a60a-f9cd53a29544" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-0b6be9d4-a4e7-4378-a60a-f9cd53a29544" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Deleting offline snapshot 0b6be9d4-a4e7-4378-a60a-f9cd53a29544 of volume 804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] snapshot_file for this snap is: volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[91854f73-330c-4229-8639-1db2d0d82118]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-753b86a2-05ec-4fa8-a567-c6e286e463b9" returned: 0 in 0.361s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:01 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29bf76cd-11d2-45cb-8431-62710b761849_61ziz357 Sep 07 17:01:01 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-753b86a2-05ec-4fa8-a567-c6e286e463b9" released by "delete_volume" :: held 0.839s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:01 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Created reservations ['23ae0c84-64c9-4262-94e1-ae3f7338a6d3', 'af95700f-67d6-4a68-8285-24e9c98b2277', '1996ca4d-78a7-48df-9c3d-d54d199a9339', '4f782c4c-e7a9-41f5-ba9a-be60318c2865'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:01 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 Sep 07 17:01:01 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:02 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 1073741824" returned: 0 in 0.582s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29bf76cd-11d2-45cb-8431-62710b761849_61ziz357" returned: 0 in 0.506s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bf76cd-11d2-45cb-8431-62710b761849_61ziz357 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 Sep 07 17:01:02 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-2d9bc7d5-0e92-443b-a896-a1d1c38cab55-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-2d9bc7d5-0e92-443b-a896-a1d1c38cab55-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "cinder-quobyte-2d9bc7d5-0e92-443b-a896-a1d1c38cab55" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:02 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544" returned: 0 in 0.548s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-2d9bc7d5-0e92-443b-a896-a1d1c38cab55" acquired by "delete_volume" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:02 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a61da-8e50-4177-aa5f-cddae2596eb7]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bf76cd-11d2-45cb-8431-62710b761849_61ziz357 Sep 07 17:01:02 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.405s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc280473-4ca1-4bff-bf7b-4fe43d0c63c9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Deleted volume successfully. Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7ee695b8-7ce7-405b-9b34-e85bba944a3d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-753b86a2-05ec-4fa8-a567-c6e286e463b9-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:02 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1" returned: 0 in 0.398s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.209s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:02 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250384258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca7fa0a-b1ba-4369-b58b-995e3165bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:59Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Creating volume fca7fa0a-b1ba-4369-b58b-995e3165bb7b {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:02 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:02 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 Sep 07 17:01:02 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42f0918-0e65-4879-8985-d399038eda5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb70a00-5183-4c55-b295-cd30600c73d1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:02 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b 1073741824 Sep 07 17:01:02 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e35532d-9a53-4c71-8c60-22187bb2b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:02 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume volume-ecb70a00-5183-4c55-b295-cd30600c73d1 (ecb70a00-5183-4c55-b295-cd30600c73d1): created successfully Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e35532d-9a53-4c71-8c60-22187bb2b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (9b925adb-962a-493c-8d6d-d5aa5d447309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ab2b4292-2692-4479-9ba4-10592f2a0c62 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created volume successfully. Sep 07 17:01:02 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bf76cd-11d2-45cb-8431-62710b761849_61ziz357" returned: 1 in 0.579s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29bf76cd-11d2-45cb-8431-62710b761849_61ziz357' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7524fb-ebe3-4c69-a4c0-75365e424b21]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD Sep 07 17:01:02 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84" returned: 0 in 0.542s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 Sep 07 17:01:03 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55" returned: 0 in 0.563s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55 Sep 07 17:01:03 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b 1073741824" returned: 0 in 0.628s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b Sep 07 17:01:03 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD Sep 07 17:01:03 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2d9bc7d5-0e92-443b-a896-a1d1c38cab55" returned: 0 in 0.343s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-quobyte-2d9bc7d5-0e92-443b-a896-a1d1c38cab55" released by "delete_volume" :: held 0.988s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:03 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544" returned: 0 in 0.490s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544 Sep 07 17:01:03 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Created reservations ['a859157b-587b-4ea6-a35b-98751101ba10', 'd409ef25-bcfc-4b6e-9bf5-403c8dfa8417', 'c692edaa-82f1-40ca-8d72-3b8ebbb42e9d', 'd06485ba-89f7-45b2-aba5-619571b298c1'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:03 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD" returned: 1 in 0.472s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] 29bf76cd-11d2-45cb-8431-62710b761849 was raw, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:03 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.830s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2045200822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57482018-fff8-4e20-9de6-517208c75048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:00Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Creating volume 57482018-fff8-4e20-9de6-517208c75048 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:03 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 Sep 07 17:01:03 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:03 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dc501e-e443-438c-a0a2-787e5f2c856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44d292-dcd2-4608-9a36-124d5d142f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:03 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 1073741824 Sep 07 17:01:03 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b (fca7fa0a-b1ba-4369-b58b-995e3165bb7b): created successfully Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44d292-dcd2-4608-9a36-124d5d142f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (78b604e2-3daf-417f-be5a-28d199a27b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:03 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f2f8f43d-7a3c-4203-bfe7-729ca0451a5f tempest-CreateVolumesFromSnapshotTest-922611610 None] Created volume successfully. Sep 07 17:01:03 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84.0b6be9d4-a4e7-4378-a60a-f9cd53a29544" returned: 0 in 0.398s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-0b6be9d4-a4e7-4378-a60a-f9cd53a29544" released by "_delete_snapshot" :: held 2.119s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-804f4372-caaf-4a50-bdb1-8e4c6346cc84" released by "delete_snapshot" :: held 2.151s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:04 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Created reservations ['0dab3fb8-8ede-4213-bae3-b36198a554f0', 'fa553244-e5f2-4812-9306-6a594cbf1279', '5f2a8414-77cf-4935-97bf-7da3e3f7b09b', '6e91a010-6a69-40f5-b269-70fa522e9a0b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Deleted volume successfully. Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-933952fc-2357-4b3c-8980-6744d8b1965d tempest-CreateVolumesFromImageTest-821366893 None] Lock "cinder-2d9bc7d5-0e92-443b-a896-a1d1c38cab55-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Delete snapshot completed successfully. Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-20e9525a-16b5-44a6-8d69-39a6cbbd5849 tempest-ProjectReaderTests-633524117 None] Lock "cinder-0b6be9d4-a4e7-4378-a60a-f9cd53a29544-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:04 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158" returned: 0 in 0.635s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29bf76cd-11d2-45cb-8431-62710b761849_8mdptt0tdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:04 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 1073741824" returned: 0 in 0.610s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:04 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 1G Sep 07 17:01:04 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:04 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 Sep 07 17:01:04 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:04 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048" returned: 0 in 0.329s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:04 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.287s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205385442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9b16b4-fcae-4ed5-808d-4221fd291531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:00Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Creating volume fb9b16b4-fcae-4ed5-808d-4221fd291531 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 1G" returned: 0 in 0.427s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Downloaded image 29bf76cd-11d2-45cb-8431-62710b761849 ((None, [{'url': 'file:///opt/stack/data/glance/images/29bf76cd-11d2-45cb-8431-62710b761849', 'metadata': {}}])) to volume 47c3ddbf-3274-4814-9223-91379115d158 successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Temporary image 29bf76cd-11d2-45cb-8431-62710b761849 for user ca30636caf7645138399a30d3e1feca4 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Marking volume 47c3ddbf-3274-4814-9223-91379115d158 as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:01:04 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 1073741824 Sep 07 17:01:04 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60919ec1-e781-4c9e-a385-c5b3abfabdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57482018-fff8-4e20-9de6-517208c75048', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360faa6-d5b9-4798-89da-1e06e698cd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Copying metadata from image 29bf76cd-11d2-45cb-8431-62710b761849 to 47c3ddbf-3274-4814-9223-91379115d158. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Creating volume glance metadata for volume 47c3ddbf-3274-4814-9223-91379115d158 backed by image 29bf76cd-11d2-45cb-8431-62710b761849 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '29bf76cd-11d2-45cb-8431-62710b761849', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '44dd6b09befac47a484103ac1bfcb45d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume volume-57482018-fff8-4e20-9de6-517208c75048 (57482018-fff8-4e20-9de6-517208c75048): created successfully Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360faa6-d5b9-4798-89da-1e06e698cd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (2e62e120-6fbf-4c49-a3b0-fa89dee26b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8996621b-8da6-431c-922d-41ceb530ba26 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created volume successfully. Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (099fd13f-5704-4fcf-9928-e82b71a86fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c3ddbf-3274-4814-9223-91379115d158', 'volume_size': 1, 'image_id': '29bf76cd-11d2-45cb-8431-62710b761849', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29bf76cd-11d2-45cb-8431-62710b761849', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44dd6b09befac47a484103ac1bfcb45d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af184d7b4ce748fbaa24c4196541d836', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1c3d9861ba89ab887f49fe05416cb9b57631bb31ffaebb2f57ef4df933e7c3b5b8ca729db4e11957194aa9bb804d9a46664fe79a24dc5d09b7155e6c1bfe44c', 'id': '29bf76cd-11d2-45cb-8431-62710b761849', 'created_at': datetime.datetime(2026, 9, 7, 15, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29bf76cd-11d2-45cb-8431-62710b761849/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60b9b14-de8d-494f-a0ff-33f971e35586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Volume volume-47c3ddbf-3274-4814-9223-91379115d158 (47c3ddbf-3274-4814-9223-91379115d158): created successfully Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60b9b14-de8d-494f-a0ff-33f971e35586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Flow 'volume_create_manager' (28f33f1e-2c71-4585-b222-5d5d91884317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4cdf2590-9e81-48ab-8fb4-7c6264ecf537 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Created volume successfully. Sep 07 17:01:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-804f4372-caaf-4a50-bdb1-8e4c6346cc84-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Lock "cinder-804f4372-caaf-4a50-bdb1-8e4c6346cc84-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-804f4372-caaf-4a50-bdb1-8e4c6346cc84" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-804f4372-caaf-4a50-bdb1-8e4c6346cc84" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c451918-c780-4fb9-b942-d0e0ac879fe6]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:05 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 Sep 07 17:01:05 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:05 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 1073741824" returned: 0 in 0.628s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:05 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 Sep 07 17:01:05 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:05 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84" returned: 0 in 0.475s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:05 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84 Sep 07 17:01:05 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:05 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531" returned: 0 in 0.303s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.889s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2060487700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f916ae-28c1-44aa-9eab-7b1f16c35911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508486361ca44a5bb0096ea7bc13c018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:01Z,use_quota=True,user_id='5e25b1df14084ab7b6e46f018f2c8a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Creating volume f2f916ae-28c1-44aa-9eab-7b1f16c35911 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:05 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:05 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 1073741824 Sep 07 17:01:05 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8b7b5-67e5-4626-8236-8efddf7a9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9b16b4-fcae-4ed5-808d-4221fd291531', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bb44eb-cf08-4b12-bd00-c523ecf98c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:05 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 (fb9b16b4-fcae-4ed5-808d-4221fd291531): created successfully Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bb44eb-cf08-4b12-bd00-c523ecf98c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (74f4bd74-284c-405d-8411-d6465361b888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4908fc25-538c-4cfc-a637-705ca031455a tempest-CreateVolumesFromSnapshotTest-922611610 None] Created volume successfully. Sep 07 17:01:05 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-804f4372-caaf-4a50-bdb1-8e4c6346cc84" returned: 0 in 0.359s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Acquiring lock "cinder-47c3ddbf-3274-4814-9223-91379115d158-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-804f4372-caaf-4a50-bdb1-8e4c6346cc84" released by "delete_volume" :: held 0.920s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "cinder-47c3ddbf-3274-4814-9223-91379115d158-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Acquiring lock "cinder-quobyte-47c3ddbf-3274-4814-9223-91379115d158" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "cinder-quobyte-47c3ddbf-3274-4814-9223-91379115d158" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Created reservations ['0f788f66-681c-43c9-8ecb-a99083553ca9', 'b965dcfc-251c-4e0f-8d2a-67905e38a9e3', '45cff727-e946-4a36-97ca-2b957930efc1', '389cba7d-db35-4d43-a6ed-cb2226778bb1'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b445b2c1-40fe-47db-b442-75924f0e6f8b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:06 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 Sep 07 17:01:06 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:06 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:06 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:06 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 1073741824" returned: 0 in 0.749s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:06 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 Sep 07 17:01:06 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:06 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.394s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Deleted volume successfully. Sep 07 17:01:06 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158" returned: 0 in 0.547s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-1bc08b75-ceae-47d3-80d1-4b2be6146de1 tempest-ProjectReaderTests-633524117 None] Lock "cinder-804f4372-caaf-4a50-bdb1-8e4c6346cc84-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:06 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158 Sep 07 17:01:06 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:06 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911" returned: 0 in 0.358s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fad1ef0-91fa-4ec6-9b78-376f29ccc7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aab090-7577-485d-893e-624c4646eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:06 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Volume volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 (f2f916ae-28c1-44aa-9eab-7b1f16c35911): created successfully Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aab090-7577-485d-893e-624c4646eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Flow 'volume_create_manager' (2541c8d4-ae41-49f1-84f3-ff41e4096002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:06 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-47c3ddbf-3274-4814-9223-91379115d158" returned: 0 in 0.301s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-19475c60-7734-42b5-8aab-32b0ec9b91e4 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created volume successfully. Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "cinder-quobyte-47c3ddbf-3274-4814-9223-91379115d158" released by "delete_volume" :: held 0.898s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Created reservations ['eb445064-7895-41c7-83d7-9923115554f3', 'cb70b707-8c81-48a5-9b39-7e453d74df1b', '239d3378-008c-4ed2-bb8f-33ae4932b5a8', '9b2ead68-ed83-4c70-be4f-e346d9fe0747'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:07 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:07 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:07 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.249s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:07 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Deleted volume successfully. Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-58ad7002-e488-4889-871a-061312cf5354 tempest-VolumeAndVolumeTypeFromImageTest-1190882286 None] Lock "cinder-47c3ddbf-3274-4814-9223-91379115d158-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-f2f916ae-28c1-44aa-9eab-7b1f16c35911-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-f2f916ae-28c1-44aa-9eab-7b1f16c35911-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-f2f916ae-28c1-44aa-9eab-7b1f16c35911" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-f2f916ae-28c1-44aa-9eab-7b1f16c35911" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d5641a-e61a-4065-974c-f47a3a645d32]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (bad20ec6-29df-441c-bbbc-ea1824cfe822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bd18dc-6ebf-44f6-b9af-8c1443793d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:07 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 Sep 07 17:01:07 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bd18dc-6ebf-44f6-b9af-8c1443793d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481883479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2148be-2683-43ff-bfce-8bbf548bc669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:08Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1249aa7-2624-4bb4-aef2-a778bab91d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1249aa7-2624-4bb4-aef2-a778bab91d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00530de4-7ab0-47d3-a085-a543604d3180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00530de4-7ab0-47d3-a085-a543604d3180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2148be-2683-43ff-bfce-8bbf548bc669', 'volume_name': 'volume-ef2148be-2683-43ff-bfce-8bbf548bc669', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39532c6-43a5-4b22-9caf-a5c00d503afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39532c6-43a5-4b22-9caf-a5c00d503afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38d717f-ff28-487e-88e8-2aa260b3d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:07 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Volume ef2148be-2683-43ff-bfce-8bbf548bc669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2148be-2683-43ff-bfce-8bbf548bc669', 'volume_size': 1} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1481883479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2148be-2683-43ff-bfce-8bbf548bc669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:08Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Creating volume ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:07 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:08 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 1073741824 Sep 07 17:01:08 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:08 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911" returned: 0 in 0.419s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:08 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911 Sep 07 17:01:08 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:08 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f2f916ae-28c1-44aa-9eab-7b1f16c35911" returned: 0 in 0.412s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:08 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 1073741824" returned: 0 in 0.656s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-f2f916ae-28c1-44aa-9eab-7b1f16c35911" released by "delete_volume" :: held 0.904s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:08 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 Sep 07 17:01:08 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created reservations ['d0363b14-7fb9-4674-b184-4176e997196b', '28a0c454-aa11-40c9-b0a2-e42a58f77f3c', '657d768b-fbe3-43ad-8f51-57eff7538ba9', '4e231466-3228-4785-96fa-c30ed0e08470'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (c4e05bf9-cd76-4646-89f4-13dd931532dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5230cd54-0bab-412e-aada-624331345f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5230cd54-0bab-412e-aada-624331345f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767307698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3174cf1b-5e41-418a-891c-9778ca3424b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:09Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f087270-cf8f-4872-8fb4-e1870da8c3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f087270-cf8f-4872-8fb4-e1870da8c3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8352f1a-7072-4512-8620-454569563f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8352f1a-7072-4512-8620-454569563f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3174cf1b-5e41-418a-891c-9778ca3424b6', 'volume_name': 'volume-3174cf1b-5e41-418a-891c-9778ca3424b6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59597eef-bf4b-4ae4-b41a-83901c08d4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59597eef-bf4b-4ae4-b41a-83901c08d4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d391a496-b9cd-4751-9641-5d1f028ea7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:08 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume 3174cf1b-5e41-418a-891c-9778ca3424b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3174cf1b-5e41-418a-891c-9778ca3424b6', 'volume_size': 1} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:09 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:09 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:09 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.104s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1767307698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3174cf1b-5e41-418a-891c-9778ca3424b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:09Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Creating volume 3174cf1b-5e41-418a-891c-9778ca3424b6 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:09 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38d717f-ff28-487e-88e8-2aa260b3d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2148be-2683-43ff-bfce-8bbf548bc669', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79957cf2-a054-4eaa-8b7e-4c684719b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:09 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 1073741824 Sep 07 17:01:09 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:09 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Volume volume-ef2148be-2683-43ff-bfce-8bbf548bc669 (ef2148be-2683-43ff-bfce-8bbf548bc669): created successfully Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79957cf2-a054-4eaa-8b7e-4c684719b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (bad20ec6-29df-441c-bbbc-ea1824cfe822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b5f8dce2-7b8e-4caf-afbd-2b10c9545703 tempest-ProjectReaderTests-633524117 None] Created volume successfully. Sep 07 17:01:09 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.262s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Deleted volume successfully. Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7f9c0a01-5b88-4972-810b-2cd3d8760dc8 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-f2f916ae-28c1-44aa-9eab-7b1f16c35911-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:09 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 1073741824" returned: 0 in 0.507s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:09 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 Sep 07 17:01:09 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:09 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6" returned: 0 in 0.285s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d391a496-b9cd-4751-9641-5d1f028ea7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3174cf1b-5e41-418a-891c-9778ca3424b6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459aac0-08cc-4f4a-adb7-cdcac8fd6ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:09 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume volume-3174cf1b-5e41-418a-891c-9778ca3424b6 (3174cf1b-5e41-418a-891c-9778ca3424b6): created successfully Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8459aac0-08cc-4f4a-adb7-cdcac8fd6ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:09 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (c4e05bf9-cd76-4646-89f4-13dd931532dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:09 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-39f6b50b-429d-4e24-b673-5662ed24a4a0 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created volume successfully. Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-fb9b16b4-fcae-4ed5-808d-4221fd291531-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-fb9b16b4-fcae-4ed5-808d-4221fd291531-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-fb9b16b4-fcae-4ed5-808d-4221fd291531" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-fb9b16b4-fcae-4ed5-808d-4221fd291531" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[234cefdd-3c96-4591-a798-025af8a3917a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Creating offline snapshot f24e89f5-c21b-4c15-851c-ed7cc131286a of volume ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96d796-6898-42a0-90c1-37b9685a6a7e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:10 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 Sep 07 17:01:10 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:10 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 Sep 07 17:01:10 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:10 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531" returned: 0 in 0.456s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:10 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531 Sep 07 17:01:10 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:10 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669" returned: 0 in 0.537s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:10 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a 1G Sep 07 17:01:10 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:10 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb9b16b4-fcae-4ed5-808d-4221fd291531" returned: 0 in 0.320s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:10 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-fb9b16b4-fcae-4ed5-808d-4221fd291531" released by "delete_volume" :: held 0.833s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created reservations ['70cd0b3b-2272-44e5-95f0-2fc9472adfa1', 'ea333bba-75f4-4e1b-a189-4a6b3763fd23', 'a19d7943-7e3f-4318-b27c-3983b12654cd', '7875e662-dd4c-4d8e-8a64-3089a15c9b24'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:11 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:11 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-57482018-fff8-4e20-9de6-517208c75048-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-57482018-fff8-4e20-9de6-517208c75048-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-57482018-fff8-4e20-9de6-517208c75048" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-57482018-fff8-4e20-9de6-517208c75048" acquired by "delete_volume" :: waited 0.048s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:11 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a 1G" returned: 0 in 0.682s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2148be-2683-43ff-bfce-8bbf548bc669 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6eeb65-9fdd-4b93-9c22-157fc7f61355]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:11 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2148be-2683-43ff-bfce-8bbf548bc669 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a Sep 07 17:01:11 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:11 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.573s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Deleted volume successfully. Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (5dab1b63-4230-4875-a8e0-7697f32c5b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca2883b-c6ca-4ddf-9769-c0d30d073fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ca2883b-c6ca-4ddf-9769-c0d30d073fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666253104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6bf18-15b8-455b-aef5-6c1911a20e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:12Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:11 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 Sep 07 17:01:11 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0f932b-50a3-44b9-9967-4a8578ccc890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0f932b-50a3-44b9-9967-4a8578ccc890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bde52a7-4a93-471b-8338-afb1bbcc402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bde52a7-4a93-471b-8338-afb1bbcc402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b6bf18-15b8-455b-aef5-6c1911a20e91', 'volume_name': 'volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23bea00-f94b-4d01-99e8-95fd19fdbf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23bea00-f94b-4d01-99e8-95fd19fdbf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe96699-40c2-4c3f-a142-e61620d034fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:11 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume c4b6bf18-15b8-455b-aef5-6c1911a20e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91', 'volume_size': 1} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5c1c7767-6f05-4e35-8ad3-e711206c44e1 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-fb9b16b4-fcae-4ed5-808d-4221fd291531-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:12 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2148be-2683-43ff-bfce-8bbf548bc669 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a" returned: 0 in 0.491s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:12 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a is being set with open permissions: ugo+rw Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:12 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a Sep 07 17:01:12 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:12 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048" returned: 0 in 0.716s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:12 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048 Sep 07 17:01:12 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:12 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a" returned: 0 in 0.504s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (acc9709b-a4a1-4776-acba-97c97fa01256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda4ebf3-bb40-42e2-9860-82596087e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda4ebf3-bb40-42e2-9860-82596087e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1689212726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1099b387-1f25-45f9-898a-23efc1de12f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:12Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:12 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.info Sep 07 17:01:12 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0f5a55-b920-41fa-b064-6f01ac7b7cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0f5a55-b920-41fa-b064-6f01ac7b7cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea25372a-78e6-4a5a-8a50-41789f2489ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea25372a-78e6-4a5a-8a50-41789f2489ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1099b387-1f25-45f9-898a-23efc1de12f1', 'volume_name': 'volume-1099b387-1f25-45f9-898a-23efc1de12f1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61badfd3-98a3-4e29-8597-54cfb4af86e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61badfd3-98a3-4e29-8597-54cfb4af86e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394c0c4a-dc73-4913-87a7-3aac3ef0e4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume 1099b387-1f25-45f9-898a-23efc1de12f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1099b387-1f25-45f9-898a-23efc1de12f1', 'volume_size': 1} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-57482018-fff8-4e20-9de6-517208c75048" returned: 0 in 0.441s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-57482018-fff8-4e20-9de6-517208c75048" released by "delete_volume" :: held 1.296s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Created reservations ['636bd663-b5cc-4633-83ec-e5d99cb83853', 'adea94ee-6f01-47b7-9877-a9e0bb8573a7', 'a6ac0a4f-c435-4e0b-86c8-4a4cdf0d2e5e', 'bb447bf8-ef28-4907-9063-dab2f10f3f66'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:12 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.info" returned: 0 in 0.332s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:12 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.info is being set with open permissions: ugo+rw Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:12 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.info Sep 07 17:01:12 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:13 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:13 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (497c5cf3-6c07-490a-9af3-7cbd58e5b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c45d9f-477d-4ef1-9930-c93d485a251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c45d9f-477d-4ef1-9930-c93d485a251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628274888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2186212c-cef1-4966-99e0-a5cd0ec55e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:13Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917e2a7-6a54-439f-b1f0-6d1f9a1f4c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b917e2a7-6a54-439f-b1f0-6d1f9a1f4c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92436161-e3a1-4907-bd62-e5b49f43f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92436161-e3a1-4907-bd62-e5b49f43f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2186212c-cef1-4966-99e0-a5cd0ec55e7c', 'volume_name': 'volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4961151d-07ad-43d1-b287-f9781cb5784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4961151d-07ad-43d1-b287-f9781cb5784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa0835e-7c14-4090-8e8b-58e17f9a558e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume 2186212c-cef1-4966-99e0-a5cd0ec55e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c', 'volume_size': 1} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:13 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.info" returned: 0 in 0.350s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666253104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b6bf18-15b8-455b-aef5-6c1911a20e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:12Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:13 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 1073741824 Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Creating volume c4b6bf18-15b8-455b-aef5-6c1911a20e91 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:13 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b4d62050-5dca-4f77-a72b-ff554fc9b5d5 tempest-ProjectReaderTests-633524117 None] Create snapshot completed successfully Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.487s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (877297a8-7dd1-436c-a106-99f6544ec27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:13 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b89dee2-53f1-4c48-91e9-560973c31809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Deleted volume successfully. Sep 07 17:01:13 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b89dee2-53f1-4c48-91e9-560973c31809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413793235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7472d25e-06bf-459c-b4c9-69b237229cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:13Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe98fe71-8ed1-4197-b663-b4fbf66e73ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe98fe71-8ed1-4197-b663-b4fbf66e73ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f24d4c-7c6a-4853-8c08-08d57806ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f24d4c-7c6a-4853-8c08-08d57806ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7472d25e-06bf-459c-b4c9-69b237229cf7', 'volume_name': 'volume-7472d25e-06bf-459c-b4c9-69b237229cf7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f0ec7-deca-4100-885a-a231ee992eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f0ec7-deca-4100-885a-a231ee992eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5ab20c-087a-452f-9f32-33c2490d3ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume 7472d25e-06bf-459c-b4c9-69b237229cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7472d25e-06bf-459c-b4c9-69b237229cf7', 'volume_size': 1} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-fca7fa0a-b1ba-4369-b58b-995e3165bb7b-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f5f57c28-3293-4fa4-8e3a-f20358e4674e tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-57482018-fff8-4e20-9de6-517208c75048-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-fca7fa0a-b1ba-4369-b58b-995e3165bb7b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-fca7fa0a-b1ba-4369-b58b-995e3165bb7b" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-fca7fa0a-b1ba-4369-b58b-995e3165bb7b" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa702f7-35ca-4326-8151-90e173a3fceb]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:14 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b Sep 07 17:01:14 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:14 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 1073741824" returned: 0 in 0.778s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (9a95efd8-7ded-49db-9079-283a651a68e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b246496e-c532-49c0-bacf-bb538ffc0aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b246496e-c532-49c0-bacf-bb538ffc0aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367517738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01615195-9b73-4f27-b217-41823cf14892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:14Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:14 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 Sep 07 17:01:14 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f986ffd2-1778-4ab8-965e-59259dcda76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f986ffd2-1778-4ab8-965e-59259dcda76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb697f-2721-494b-8867-f790e08aacb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb697f-2721-494b-8867-f790e08aacb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01615195-9b73-4f27-b217-41823cf14892', 'volume_name': 'volume-01615195-9b73-4f27-b217-41823cf14892', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6971b5c4-de45-4680-b50d-c39a34ecd3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6971b5c4-de45-4680-b50d-c39a34ecd3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bc3d82-9626-4d42-960b-a4f2fd4fb7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume 01615195-9b73-4f27-b217-41823cf14892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01615195-9b73-4f27-b217-41823cf14892', 'volume_size': 1} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:14 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b" returned: 0 in 0.479s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:14 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b Sep 07 17:01:14 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:14 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1689212726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1099b387-1f25-45f9-898a-23efc1de12f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:12Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Creating volume 1099b387-1f25-45f9-898a-23efc1de12f1 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:14 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-f24e89f5-c21b-4c15-851c-ed7cc131286a-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:14 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 1073741824 Sep 07 17:01:14 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Lock "cinder-f24e89f5-c21b-4c15-851c-ed7cc131286a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-ef2148be-2683-43ff-bfce-8bbf548bc669" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe96699-40c2-4c3f-a142-e61620d034fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9ca026-6b41-4d7a-a48e-7ae53bddd565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-ef2148be-2683-43ff-bfce-8bbf548bc669" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-f24e89f5-c21b-4c15-851c-ed7cc131286a" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 (c4b6bf18-15b8-455b-aef5-6c1911a20e91): created successfully Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9ca026-6b41-4d7a-a48e-7ae53bddd565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (5dab1b63-4230-4875-a8e0-7697f32c5b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-f24e89f5-c21b-4c15-851c-ed7cc131286a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Deleting offline snapshot f24e89f5-c21b-4c15-851c-ed7cc131286a of volume ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] snapshot_file for this snap is: volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:14 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fcd1eef0-3303-4c51-9172-979515ab5269 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created volume successfully. Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49c4b98-2a2d-4456-8616-82b894e28b20]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:14 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fca7fa0a-b1ba-4369-b58b-995e3165bb7b" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-fca7fa0a-b1ba-4369-b58b-995e3165bb7b" released by "delete_volume" :: held 0.970s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:14 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created reservations ['7e2cfd74-3e29-4ada-b374-d7758d0eaca5', '51d4d744-3543-40e2-998e-453ad93b05b2', '445dee4d-0647-43f5-b802-c09ebd8adfeb', 'dc8ab319-c912-423a-9330-30c356a3f3dc'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:14 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a Sep 07 17:01:14 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:15 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:15 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 1073741824" returned: 0 in 0.706s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Flow 'volume_create_manager' (65eb9069-51f6-4a10-a569-213b720ddaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:15 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f3b895-3c12-4ced-b1e6-ebee93d9ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a" returned: 0 in 0.579s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef2148be-2683-43ff-bfce-8bbf548bc669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f3b895-3c12-4ced-b1e6-ebee93d9ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-566600079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed14aa03-075a-4fff-9df1-d22daf96edca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edb5717e6ce4528b37f49ab34a2d731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:15Z,use_quota=True,user_id='a661cc147dd14b379a28092c6189ba5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a3833c-7c1a-4b96-b8d6-4aa941b2a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a3833c-7c1a-4b96-b8d6-4aa941b2a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55583fd-23b9-4a46-aa9c-9e84043467c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55583fd-23b9-4a46-aa9c-9e84043467c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed14aa03-075a-4fff-9df1-d22daf96edca', 'volume_name': 'volume-ed14aa03-075a-4fff-9df1-d22daf96edca', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52a4c86-d476-4b19-a9bf-8396d5b1d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52a4c86-d476-4b19-a9bf-8396d5b1d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75043fce-ba49-4692-a19f-d5f8b6e3f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Volume ed14aa03-075a-4fff-9df1-d22daf96edca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed14aa03-075a-4fff-9df1-d22daf96edca', 'volume_size': 1} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1442427-12c7-43c6-8825-9bc0d624d2b4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:15 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.357s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:15 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Deleted volume successfully. Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:15 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 Sep 07 17:01:15 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-28dd3550-3e79-4e35-ab73-f1bfcfc15d05 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-fca7fa0a-b1ba-4369-b58b-995e3165bb7b-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:15 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 Sep 07 17:01:15 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1" returned: 0 in 0.286s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.516s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628274888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2186212c-cef1-4966-99e0-a5cd0ec55e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:13Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Creating volume 2186212c-cef1-4966-99e0-a5cd0ec55e7c {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:15 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:15 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c 1073741824 Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394c0c4a-dc73-4913-87a7-3aac3ef0e4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1099b387-1f25-45f9-898a-23efc1de12f1', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea80b44-3396-4a98-a9a2-55b18887fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume volume-1099b387-1f25-45f9-898a-23efc1de12f1 (1099b387-1f25-45f9-898a-23efc1de12f1): created successfully Sep 07 17:01:15 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea80b44-3396-4a98-a9a2-55b18887fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (acc9709b-a4a1-4776-acba-97c97fa01256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669" returned: 0 in 0.387s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:15 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b902709a-2381-412b-a7dc-12ca4173df8d tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created volume successfully. Sep 07 17:01:15 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a Sep 07 17:01:15 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-ecb70a00-5183-4c55-b295-cd30600c73d1-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-ecb70a00-5183-4c55-b295-cd30600c73d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-ecb70a00-5183-4c55-b295-cd30600c73d1" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-ecb70a00-5183-4c55-b295-cd30600c73d1" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f683c12-432f-436b-bc0b-7a8f7bfa608a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a" returned: 0 in 0.401s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a Sep 07 17:01:16 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 Sep 07 17:01:16 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c 1073741824" returned: 0 in 0.578s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c Sep 07 17:01:16 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669.f24e89f5-c21b-4c15-851c-ed7cc131286a" returned: 0 in 0.305s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-f24e89f5-c21b-4c15-851c-ed7cc131286a" released by "_delete_snapshot" :: held 1.832s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-ef2148be-2683-43ff-bfce-8bbf548bc669" released by "delete_snapshot" :: held 1.874s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:16 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1" returned: 0 in 0.460s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1 Sep 07 17:01:16 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Created reservations ['16482e58-664a-4c03-ad2f-9680272d4f9a', '041b1b1d-d21c-454a-93eb-aa1257196f75', 'fc2345ae-378a-4eb0-8a52-406c788f59f8', '14ace139-bb6a-4c80-9483-8469789979d6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:16 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.953s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413793235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7472d25e-06bf-459c-b4c9-69b237229cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:13Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Creating volume 7472d25e-06bf-459c-b4c9-69b237229cf7 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:16 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 1073741824 Sep 07 17:01:16 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa0835e-7c14-4090-8e8b-58e17f9a558e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9dfa797-5fab-43c2-a03c-223654ac8960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Delete snapshot completed successfully. Sep 07 17:01:16 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c (2186212c-cef1-4966-99e0-a5cd0ec55e7c): created successfully Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9dfa797-5fab-43c2-a03c-223654ac8960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (497c5cf3-6c07-490a-9af3-7cbd58e5b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b933cbb-7590-4f0f-955f-a8a64023ea7a tempest-ProjectReaderTests-633524117 None] Lock "cinder-f24e89f5-c21b-4c15-851c-ed7cc131286a-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-ef2148be-2683-43ff-bfce-8bbf548bc669-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-cabaa68e-fd83-4ffd-8fa4-17d405c8f91e tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created volume successfully. Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Lock "cinder-ef2148be-2683-43ff-bfce-8bbf548bc669-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:16 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ecb70a00-5183-4c55-b295-cd30600c73d1" returned: 0 in 0.341s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-ef2148be-2683-43ff-bfce-8bbf548bc669" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-ecb70a00-5183-4c55-b295-cd30600c73d1" released by "delete_volume" :: held 0.850s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-ef2148be-2683-43ff-bfce-8bbf548bc669" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b441fa-e952-4268-8efb-1d5920bbfd4e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Created reservations ['2ab9849b-f9f1-4ed9-b444-a87b5f91ee2a', '8098818c-788b-4fa7-99af-7aa6db721672', '6997ebff-da7d-4a7c-beb9-b69e1cf6fc79', '9dd3148a-641c-44b7-b6db-fea5c22dfbce'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 Sep 07 17:01:17 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:17 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-6e76b919-f55e-4db9-a18b-c4bd335b93fc-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-6e76b919-f55e-4db9-a18b-c4bd335b93fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-6e76b919-f55e-4db9-a18b-c4bd335b93fc" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:17 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 1073741824" returned: 0 in 0.597s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-6e76b919-f55e-4db9-a18b-c4bd335b93fc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Deleting offline snapshot 6e76b919-f55e-4db9-a18b-c4bd335b93fc of volume 1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] snapshot_file for this snap is: volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ee97f2-7232-4273-8dc5-d05f5e624475]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 Sep 07 17:01:17 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.327s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:17 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Deleted volume successfully. Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e3d530e1-da1a-4200-8582-c40b8b0eae9d tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-ecb70a00-5183-4c55-b295-cd30600c73d1-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:17 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc Sep 07 17:01:17 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669" returned: 0 in 0.544s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669 Sep 07 17:01:17 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.375s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-367517738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01615195-9b73-4f27-b217-41823cf14892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ea7d8d6b004b82a5ab550a8d3e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:14Z,use_quota=True,user_id='ee7e94c43b584c27b6821ae7cf225ed4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Creating volume 01615195-9b73-4f27-b217-41823cf14892 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:17 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5ab20c-087a-452f-9f32-33c2490d3ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7472d25e-06bf-459c-b4c9-69b237229cf7', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:17 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 1073741824 Sep 07 17:01:17 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64fcac8-77aa-4312-8f8f-3807c0bf7cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume volume-7472d25e-06bf-459c-b4c9-69b237229cf7 (7472d25e-06bf-459c-b4c9-69b237229cf7): created successfully Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64fcac8-77aa-4312-8f8f-3807c0bf7cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (877297a8-7dd1-436c-a106-99f6544ec27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:17 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-cb7e1bd9-eb09-432d-abbe-e536b14450d9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created volume successfully. Sep 07 17:01:17 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc" returned: 0 in 0.493s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc1fc36-42ea-4566-bbab-2b01ec1591d3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ef2148be-2683-43ff-bfce-8bbf548bc669" returned: 0 in 0.346s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-ef2148be-2683-43ff-bfce-8bbf548bc669" released by "delete_volume" :: held 0.960s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:17 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Created reservations ['ba69afec-3c9e-41af-ad87-fd397dbdb7ef', 'e4adcbff-d6a9-4fa8-84ae-1062ca08ccc4', '1a7e667a-4700-4bd1-878a-d9a63d0e1a5b', '4f853df1-76e1-48bf-a539-810c2b757785'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:18 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 Sep 07 17:01:18 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:18 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 1073741824" returned: 0 in 0.521s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 Sep 07 17:01:18 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" returned: 0 in 0.437s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc Sep 07 17:01:18 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.323s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Deleted volume successfully. Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0f67c799-b0b5-4378-8135-518db03f543b tempest-ProjectReaderTests-633524117 None] Lock "cinder-ef2148be-2683-43ff-bfce-8bbf548bc669-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:18 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892" returned: 0 in 0.303s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.154s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-566600079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed14aa03-075a-4fff-9df1-d22daf96edca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edb5717e6ce4528b37f49ab34a2d731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:15Z,use_quota=True,user_id='a661cc147dd14b379a28092c6189ba5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Creating volume ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:18 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bc3d82-9626-4d42-960b-a4f2fd4fb7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01615195-9b73-4f27-b217-41823cf14892', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:18 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca 1073741824 Sep 07 17:01:18 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f657e4ba-246e-41c6-90fa-121ad40ee07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:18 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Volume volume-01615195-9b73-4f27-b217-41823cf14892 (01615195-9b73-4f27-b217-41823cf14892): created successfully Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f657e4ba-246e-41c6-90fa-121ad40ee07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Flow 'volume_create_manager' (9a95efd8-7ded-49db-9079-283a651a68e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-923996c8-d928-4f87-9812-4578d0651fc9 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created volume successfully. Sep 07 17:01:18 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc" returned: 0 in 0.422s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc Sep 07 17:01:18 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-01615195-9b73-4f27-b217-41823cf14892-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-01615195-9b73-4f27-b217-41823cf14892-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-quobyte-01615195-9b73-4f27-b217-41823cf14892" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-01615195-9b73-4f27-b217-41823cf14892" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[773b4b6f-6892-4e32-bb41-1b7cf8362576]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:19 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3.6e76b919-f55e-4db9-a18b-c4bd335b93fc" returned: 0 in 0.334s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:19 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 Sep 07 17:01:19 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-6e76b919-f55e-4db9-a18b-c4bd335b93fc" released by "_delete_snapshot" :: held 1.820s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" released by "delete_snapshot" :: held 1.860s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:19 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca 1073741824" returned: 0 in 0.580s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:19 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca Sep 07 17:01:19 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created reservations ['b442f77a-4721-49f3-b9e9-41ffc4827b58', '58c7fb07-d085-46e1-9166-afb58d64f27a', 'f86e4b2b-b90d-4809-9402-68f7de91cf24', '03e9d59a-599b-41de-acf8-a826db98cab8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Delete snapshot completed successfully. Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a97253eb-6d7c-438f-b052-b8a425edcc50 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-6e76b919-f55e-4db9-a18b-c4bd335b93fc-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:19 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892" returned: 0 in 0.460s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:19 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892 Sep 07 17:01:19 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "cinder-quobyte-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" acquired by "delete_volume" :: waited 0.040s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:19 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca" returned: 0 in 0.493s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[33425be6-83fd-4bd6-be1c-a53cc7224846]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75043fce-ba49-4692-a19f-d5f8b6e3f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed14aa03-075a-4fff-9df1-d22daf96edca', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bb4cd4-35a9-4d2a-b92c-49bd8c3a0338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:19 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:19 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Volume volume-ed14aa03-075a-4fff-9df1-d22daf96edca (ed14aa03-075a-4fff-9df1-d22daf96edca): created successfully Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bb4cd4-35a9-4d2a-b92c-49bd8c3a0338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Flow 'volume_create_manager' (65eb9069-51f6-4a10-a569-213b720ddaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-01615195-9b73-4f27-b217-41823cf14892" returned: 0 in 0.376s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-01615195-9b73-4f27-b217-41823cf14892" released by "delete_volume" :: held 0.883s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-670569da-2080-41a7-b6fb-e988c834f9e7 tempest-VolumeDependencyTests-914395665 None] Created volume successfully. Sep 07 17:01:19 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 Sep 07 17:01:19 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:19 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created reservations ['0fd498c6-7272-46f2-9558-f9cec285f286', '34415182-db9c-4532-80db-3ec47d885560', '8e358529-c5c4-4d54-b70e-420524cd9e62', '2db62026-4074-4cf7-acd9-0763dc3d6dc3'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:20 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:20 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-7472d25e-06bf-459c-b4c9-69b237229cf7-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-7472d25e-06bf-459c-b4c9-69b237229cf7-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:20 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (f1e6b419-ec27-4e33-8f76-c838bc1e55f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f5f569-1c3d-42ec-aad7-49dc8c725b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" returned: 0 in 0.596s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f5f569-1c3d-42ec-aad7-49dc8c725b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-452570609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85357b8-1195-41ff-8a21-1bf78f5e029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:20Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e516a5a8-2573-42af-94fa-1d5210e9f804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e516a5a8-2573-42af-94fa-1d5210e9f804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:20 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3 Sep 07 17:01:20 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5d6002-d519-46a8-bb26-8f36e0c04f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5d6002-d519-46a8-bb26-8f36e0c04f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85357b8-1195-41ff-8a21-1bf78f5e029d', 'volume_name': 'volume-f85357b8-1195-41ff-8a21-1bf78f5e029d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fda995-8c88-4f27-a2e6-716a3b719619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fda995-8c88-4f27-a2e6-716a3b719619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0d41d0-7d3a-4ed9-961e-a73995419580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:20 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Volume f85357b8-1195-41ff-8a21-1bf78f5e029d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85357b8-1195-41ff-8a21-1bf78f5e029d', 'volume_size': 1} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-452570609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85357b8-1195-41ff-8a21-1bf78f5e029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:20Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Creating volume f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:20 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:20 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.351s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:20 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d 1073741824 Sep 07 17:01:20 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-quobyte-7472d25e-06bf-459c-b4c9-69b237229cf7" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:20 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Deleted volume successfully. Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-7472d25e-06bf-459c-b4c9-69b237229cf7" acquired by "delete_volume" :: waited 0.039s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-082c0231-e337-4c07-b849-e74baa302fde tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-01615195-9b73-4f27-b217-41823cf14892-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2db562-dae5-4014-a26a-c82e1fe54337]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:20 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 Sep 07 17:01:20 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:20 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" returned: 0 in 0.350s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-quobyte-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3" released by "delete_volume" :: held 1.048s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Created reservations ['bc4eafa6-f85e-458e-8189-d364d6fd857f', '825b1a30-464a-4333-bebb-ab8b5469d3d4', 'b1945d92-bc3e-462e-8c4e-58c1942fe328', '5632a24b-540d-412c-b01a-21288c4e9429'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:20 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:20 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:20 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d 1073741824" returned: 0 in 0.603s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:20 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7" returned: 0 in 0.510s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:21 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7 Sep 07 17:01:21 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:21 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d Sep 07 17:01:21 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:21 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.319s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Deleted volume successfully. Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dc16e26-648f-423f-99d4-81957a534ee5 tempest-CreateVolumesFromSnapshotTest-922611610 None] Lock "cinder-1fe67b6d-9f9e-4d2c-8065-1dd62ba2dec3-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:21 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7472d25e-06bf-459c-b4c9-69b237229cf7" returned: 0 in 0.285s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-7472d25e-06bf-459c-b4c9-69b237229cf7" released by "delete_volume" :: held 0.849s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created reservations ['cb732263-4d26-4a71-9fae-8a5f37b6788c', '3e8d4e35-14ff-4409-848d-7c9692df7f53', '2ed6fe26-8c52-41cf-b78e-add3277d4792', '33d852c3-0115-48ef-b413-adc961918ab8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:21 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.325s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Creating offline snapshot d01dd222-a4e2-4d04-8952-1bc443a3d7ff of volume ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0d41d0-7d3a-4ed9-961e-a73995419580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85357b8-1195-41ff-8a21-1bf78f5e029d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dc0ba3-8992-45b0-915c-85041b55071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5957791c-33a5-4460-9c92-a27a52022d45]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:21 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Volume volume-f85357b8-1195-41ff-8a21-1bf78f5e029d (f85357b8-1195-41ff-8a21-1bf78f5e029d): created successfully Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25dc0ba3-8992-45b0-915c-85041b55071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (f1e6b419-ec27-4e33-8f76-c838bc1e55f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-692126b6-ad4c-43e1-8b42-b1a074fc380b tempest-ProjectReaderTests-633524117 None] Created volume successfully. Sep 07 17:01:21 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:21 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:21 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca Sep 07 17:01:21 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:21 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.292s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Deleted volume successfully. Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-525e6e1d-758d-4014-b48b-1233b4291d88 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-7472d25e-06bf-459c-b4c9-69b237229cf7-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:21 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca" returned: 0 in 0.441s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:21 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff 1G Sep 07 17:01:21 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:22 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff 1G" returned: 0 in 0.518s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed14aa03-075a-4fff-9df1-d22daf96edca -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:22 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed14aa03-075a-4fff-9df1-d22daf96edca -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff Sep 07 17:01:22 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-2186212c-cef1-4966-99e0-a5cd0ec55e7c-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-2186212c-cef1-4966-99e0-a5cd0ec55e7c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-quobyte-2186212c-cef1-4966-99e0-a5cd0ec55e7c" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-2186212c-cef1-4966-99e0-a5cd0ec55e7c" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[75343d9c-234c-4b2c-84ff-285001959005]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:22 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c Sep 07 17:01:22 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:22 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed14aa03-075a-4fff-9df1-d22daf96edca -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff" returned: 0 in 0.442s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:22 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff is being set with open permissions: ugo+rw Sep 07 17:01:22 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:22 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff Sep 07 17:01:22 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:23 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c" returned: 0 in 0.452s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:23 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c Sep 07 17:01:23 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:23 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff" returned: 0 in 0.286s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:23 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.info Sep 07 17:01:23 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:23 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-2186212c-cef1-4966-99e0-a5cd0ec55e7c" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-2186212c-cef1-4966-99e0-a5cd0ec55e7c" released by "delete_volume" :: held 0.777s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created reservations ['801bdca1-4fca-4048-8862-528269ce998e', '816f3b62-596d-4ae7-82a4-24d71407002d', 'd5b758ec-6b9a-4afe-b9f4-8af4416e7975', '26e865ac-691f-4de0-a8bd-23ff2b8a7aec'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:23 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.info" returned: 0 in 0.311s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:23 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.info is being set with open permissions: ugo+rw Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:23 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.info Sep 07 17:01:23 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:23 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:23 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-1099b387-1f25-45f9-898a-23efc1de12f1-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-1099b387-1f25-45f9-898a-23efc1de12f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-quobyte-1099b387-1f25-45f9-898a-23efc1de12f1" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-1099b387-1f25-45f9-898a-23efc1de12f1" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba3c743-1e87-4c48-88e0-ca226656eca0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:23 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.info" returned: 0 in 0.405s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.532s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.330s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:23 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Creating offline snapshot 699d5b8f-ad7e-4f66-9577-a97703730e35 of volume f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.353s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b529e007-b27a-482c-854a-73be46e8d662 tempest-VolumeDependencyTests-914395665 None] Create snapshot completed successfully Sep 07 17:01:23 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Deleted volume successfully. Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496aa0b-8c06-4483-8d69-0bb447765d12]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:24 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 Sep 07 17:01:24 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-21e21160-6863-4db7-a3eb-087e0a5bbf20 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-2186212c-cef1-4966-99e0-a5cd0ec55e7c-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:24 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d Sep 07 17:01:24 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:24 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1" returned: 0 in 0.465s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:24 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1 Sep 07 17:01:24 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:24 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d" returned: 0 in 0.501s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:24 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 1G Sep 07 17:01:24 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:24 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-1099b387-1f25-45f9-898a-23efc1de12f1" returned: 0 in 0.409s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-1099b387-1f25-45f9-898a-23efc1de12f1" released by "delete_volume" :: held 0.934s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created reservations ['6b76b071-e0a8-4adf-ad0e-822a208e88b5', '95602f4a-1237-4afc-abc9-10dd17ee9229', '4527ff99-83d8-40e8-8c0b-32679e816033', 'c055640b-33bb-4b9c-96b3-97cda74edcc6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:25 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:25 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Flow 'volume_create_manager' (8ad98cb5-7256-47de-86e1-0333077b713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e72ddd-79e0-41ea-915d-c1fc19d2210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:25 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e72ddd-79e0-41ea-915d-c1fc19d2210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1288696599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c43066b-e067-4970-adc4-bfbb5fd559af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edb5717e6ce4528b37f49ab34a2d731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d01dd222-a4e2-4d04-8952-1bc443a3d7ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:25Z,use_quota=True,user_id='a661cc147dd14b379a28092c6189ba5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01edc0ff-6788-41b2-98bc-ca90a39db033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01edc0ff-6788-41b2-98bc-ca90a39db033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe30906f-396a-499d-ac0d-284926619e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe30906f-396a-499d-ac0d-284926619e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c43066b-e067-4970-adc4-bfbb5fd559af', 'volume_name': 'volume-7c43066b-e067-4970-adc4-bfbb5fd559af', 'volume_size': 1, 'snapshot_id': 'd01dd222-a4e2-4d04-8952-1bc443a3d7ff'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbeb130-6004-4256-85f9-c2e90455f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbeb130-6004-4256-85f9-c2e90455f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f622737-81c7-4105-b58e-5840d814d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Volume 7c43066b-e067-4970-adc4-bfbb5fd559af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c43066b-e067-4970-adc4-bfbb5fd559af', 'volume_size': 1, 'snapshot_id': 'd01dd222-a4e2-4d04-8952-1bc443a3d7ff'} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 1G" returned: 0 in 0.732s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85357b8-1195-41ff-8a21-1bf78f5e029d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:25 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85357b8-1195-41ff-8a21-1bf78f5e029d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 Sep 07 17:01:25 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:25 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Deleted volume successfully. Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a6b7489a-4ac5-4610-9f0c-9d58ffec3289 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-1099b387-1f25-45f9-898a-23efc1de12f1-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:25 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f85357b8-1195-41ff-8a21-1bf78f5e029d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35" returned: 0 in 0.349s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:25 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 is being set with open permissions: ugo+rw Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:25 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 Sep 07 17:01:25 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:25 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35" returned: 0 in 0.284s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:25 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.info Sep 07 17:01:25 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-c4b6bf18-15b8-455b-aef5-6c1911a20e91-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-c4b6bf18-15b8-455b-aef5-6c1911a20e91-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-quobyte-c4b6bf18-15b8-455b-aef5-6c1911a20e91" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-c4b6bf18-15b8-455b-aef5-6c1911a20e91" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a57f9c-b37e-4ecd-abb9-9bcb3af414bd]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:26 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.info" returned: 0 in 0.328s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:26 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.info is being set with open permissions: ugo+rw Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:26 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.info Sep 07 17:01:26 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:26 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 Sep 07 17:01:26 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:26 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.info" returned: 0 in 0.320s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.329s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-quobyte-d01dd222-a4e2-4d04-8952-1bc443a3d7ff-7c43066b-e067-4970-adc4-bfbb5fd559af" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-d01dd222-a4e2-4d04-8952-1bc443a3d7ff-7c43066b-e067-4970-adc4-bfbb5fd559af" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Creating volume 7c43066b-e067-4970-adc4-bfbb5fd559af from snapshot d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-quobyte-7c43066b-e067-4970-adc4-bfbb5fd559af" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-997b3e36-5361-45bc-a8e8-b93b71b5dc24 tempest-ProjectReaderTests-633524117 None] Create snapshot completed successfully Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-7c43066b-e067-4970-adc4-bfbb5fd559af" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] snapshot: d01dd222-a4e2-4d04-8952-1bc443a3d7ff, volume: 7c43066b-e067-4970-adc4-bfbb5fd559af, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:01:26 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91" returned: 0 in 0.502s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7d083-8db0-4cb1-8d8d-41d463442202]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:26 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91 Sep 07 17:01:26 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-699d5b8f-ad7e-4f66-9577-a97703730e35-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Lock "cinder-699d5b8f-ad7e-4f66-9577-a97703730e35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-f85357b8-1195-41ff-8a21-1bf78f5e029d" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:26 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff Sep 07 17:01:26 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-f85357b8-1195-41ff-8a21-1bf78f5e029d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-699d5b8f-ad7e-4f66-9577-a97703730e35" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-699d5b8f-ad7e-4f66-9577-a97703730e35" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Deleting offline snapshot 699d5b8f-ad7e-4f66-9577-a97703730e35 of volume f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:26 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] snapshot_file for this snap is: volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f4905a-f188-42a7-94a5-f632a10f4502]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:27 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-c4b6bf18-15b8-455b-aef5-6c1911a20e91" returned: 0 in 0.386s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-c4b6bf18-15b8-455b-aef5-6c1911a20e91" released by "delete_volume" :: held 0.941s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:27 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 Sep 07 17:01:27 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created reservations ['f2a83c58-6da0-46ff-8d9e-ce4aa5141166', '8a3f855a-38ad-4c8e-917f-fe7ee449eece', '5bffe62e-ddb0-4ffa-af6c-456b42b94258', '8be80f29-95de-4ac0-be70-82ab68431250'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:27 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff" returned: 0 in 0.559s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed14aa03-075a-4fff-9df1-d22daf96edca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69ecf70-d188-40c9-b311-834cf8c44f7c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:27 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:27 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:27 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca Sep 07 17:01:27 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:27 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35" returned: 0 in 0.521s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f85357b8-1195-41ff-8a21-1bf78f5e029d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa9b17-e05d-4e7f-96e7-ab08b1a40070]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:27 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.303s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Deleted volume successfully. Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-35ae68a9-4de4-48cd-853e-0b00c894e144 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-c4b6bf18-15b8-455b-aef5-6c1911a20e91-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:27 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d Sep 07 17:01:27 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:27 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca" returned: 0 in 0.471s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:01:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:27 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af Sep 07 17:01:27 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:28 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d" returned: 0 in 0.478s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:28 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 Sep 07 17:01:28 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-3174cf1b-5e41-418a-891c-9778ca3424b6-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-3174cf1b-5e41-418a-891c-9778ca3424b6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "cinder-quobyte-3174cf1b-5e41-418a-891c-9778ca3424b6" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-3174cf1b-5e41-418a-891c-9778ca3424b6" acquired by "delete_volume" :: waited 0.059s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f4e61-99f4-43be-8b89-564d63702bad]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:28 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35" returned: 0 in 0.796s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:28 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35 Sep 07 17:01:29 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:29 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 Sep 07 17:01:29 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:29 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d.699d5b8f-ad7e-4f66-9577-a97703730e35" returned: 0 in 0.758s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-699d5b8f-ad7e-4f66-9577-a97703730e35" released by "_delete_snapshot" :: held 2.760s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:29 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-f85357b8-1195-41ff-8a21-1bf78f5e029d" released by "delete_snapshot" :: held 2.824s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:29 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Flow 'volume_create_manager' (9dff8771-277b-4059-b1ba-49fe0e35fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97eff6b-a90a-47a3-a2fb-b9ec461029da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97eff6b-a90a-47a3-a2fb-b9ec461029da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f257c4bb-ade4-4af4-bffb-4c2fef17baf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ade892c8fba4647b02416ea46b141f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:30Z,use_quota=True,user_id='deacc46904fe492da8134eebc36c2439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4454316d-a321-45ed-ae7c-f9087a01f0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4454316d-a321-45ed-ae7c-f9087a01f0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fec5c7-2860-42ab-b980-a61a74ce1157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.image.glance [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Creating Keystone auth plugin from conf {{(pid=87492) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:01:30 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6" returned: 0 in 1.530s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:30 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6 Sep 07 17:01:30 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Created reservations ['139689a2-02c5-433b-9a56-e224d9811ac7', 'c0ed2c4b-2b3b-4d71-a8a3-3f2b80ddf54e', '44fe0c83-6d31-46e4-83e1-bf50d5573393', 'c2cebba6-6140-4098-bf0f-810398b44637'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:30 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Delete snapshot completed successfully. Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a19a3b62-16a0-4880-a874-65b09f34550e tempest-ProjectReaderTests-633524117 None] Lock "cinder-699d5b8f-ad7e-4f66-9577-a97703730e35-delete_snapshot" released by "delete_snapshot" :: held 3.653s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:30 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fec5c7-2860-42ab-b980-a61a74ce1157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f257c4bb-ade4-4af4-bffb-4c2fef17baf9', 'volume_name': 'volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9', 'volume_size': 1, 'image_id': 'e3c8dbff-690f-4b93-9e28-aa933c723052', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e3c8dbff-690f-4b93-9e28-aa933c723052', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602d12f29023f69dde86ddc4286349fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ade892c8fba4647b02416ea46b141f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c75124b7a507de6fef9c1638410ea81611b9c5569b3ac8b603bb144533a9b4f50b2751d18adeff3a6097a5df04bca7955e7d4e2d0b92aad04397967491dfbd6', 'id': 'e3c8dbff-690f-4b93-9e28-aa933c723052', 'created_at': datetime.datetime(2026, 9, 7, 15, 1, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 1, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e3c8dbff-690f-4b93-9e28-aa933c723052/file', 'properties': {}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:30 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27f77b7-2807-40f6-8978-2e2a2a52e861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27f77b7-2807-40f6-8978-2e2a2a52e861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31eb4ec-cb94-46cd-a50a-85df9a63b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:31 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Volume f257c4bb-ade4-4af4-bffb-4c2fef17baf9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9', 'volume_size': 1, 'image_id': 'e3c8dbff-690f-4b93-9e28-aa933c723052', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e3c8dbff-690f-4b93-9e28-aa933c723052', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602d12f29023f69dde86ddc4286349fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ade892c8fba4647b02416ea46b141f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c75124b7a507de6fef9c1638410ea81611b9c5569b3ac8b603bb144533a9b4f50b2751d18adeff3a6097a5df04bca7955e7d4e2d0b92aad04397967491dfbd6', 'id': 'e3c8dbff-690f-4b93-9e28-aa933c723052', 'created_at': datetime.datetime(2026, 9, 7, 15, 1, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 1, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e3c8dbff-690f-4b93-9e28-aa933c723052/file', 'properties': {}}, 'image_service': } Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Trying to clone f257c4bb-ade4-4af4-bffb-4c2fef17baf9 from image e3c8dbff-690f-4b93-9e28-aa933c723052 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e3c8dbff-690f-4b93-9e28-aa933c723052', 'metadata': {}}]). {{(pid=87492) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-3174cf1b-5e41-418a-891c-9778ca3424b6" returned: 0 in 0.844s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-quobyte-3174cf1b-5e41-418a-891c-9778ca3424b6" released by "delete_volume" :: held 2.514s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Created reservations ['d3fa7139-dad9-41ce-a293-378106d14e2e', '159bc883-72a8-4be5-8771-5f95b608b306', '3c21d8b6-4711-412d-963f-468f02aa0882', '47bf48eb-16e9-4eeb-b3d3-c19c6901a2ee'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:01:31 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Image download 0.00 MB at 0.00 MB/s Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b66e2c2-b2d8-453c-9de3-81a093a71fad]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-f85357b8-1195-41ff-8a21-1bf78f5e029d-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Lock "cinder-f85357b8-1195-41ff-8a21-1bf78f5e029d-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:31 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:31 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-f85357b8-1195-41ff-8a21-1bf78f5e029d" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:31 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD Sep 07 17:01:31 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-f85357b8-1195-41ff-8a21-1bf78f5e029d" acquired by "delete_volume" :: waited 0.060s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eb2431-cf88-4aa4-b5ec-f945779cff2d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:32 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d Sep 07 17:01:32 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:32 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.746s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:32 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Deleted volume successfully. Sep 07 17:01:32 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-42be3d90-784c-4bc1-9561-c14b6b31f7e2 tempest-CreateVolumesFromSourceVolumeTest-566422962 None] Lock "cinder-3174cf1b-5e41-418a-891c-9778ca3424b6-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:32 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD" returned: 0 in 1.217s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:33 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD Sep 07 17:01:33 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:33 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d" returned: 0 in 1.315s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:33 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d Sep 07 17:01:33 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:33 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:33 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:33 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD" returned: 1 in 1.146s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Temporary image e3c8dbff-690f-4b93-9e28-aa933c723052 is fetched for user deacc46904fe492da8134eebc36c2439. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d514364c-e6a4-4789-900e-a6c35d6ad585]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:34 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.735s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:01:34 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af" returned: 0 in 6.471s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:01:34 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Converted 1024.00 MB image at 158.21 MB/s Sep 07 17:01:34 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af is being set with open permissions: ugo+rw Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:34 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD Sep 07 17:01:34 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:34 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f85357b8-1195-41ff-8a21-1bf78f5e029d" returned: 0 in 0.958s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af Sep 07 17:01:34 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-f85357b8-1195-41ff-8a21-1bf78f5e029d" released by "delete_volume" :: held 2.491s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Created reservations ['bb181877-7ef4-48c6-9610-b706fca038bb', '8a765f5b-9373-4356-a91e-a2c4a2c24308', 'c1d38351-7f03-4c2e-9daa-6c3e9d8c4f9a', '531fd041-ef0f-4339-b4b4-a0ae6d713a81'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:34 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:34 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:34 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af" returned: 0 in 0.352s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-7c43066b-e067-4970-adc4-bfbb5fd559af" released by "_copy_volume_from_snapshot" :: held 7.976s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-d01dd222-a4e2-4d04-8952-1bc443a3d7ff-7c43066b-e067-4970-adc4-bfbb5fd559af" released by "_create_volume_from_snapshot" :: held 8.076s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.108s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:34 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD Sep 07 17:01:34 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f622737-81c7-4105-b58e-5840d814d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c43066b-e067-4970-adc4-bfbb5fd559af', 'volume_size': 1, 'snapshot_id': 'd01dd222-a4e2-4d04-8952-1bc443a3d7ff'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e757c9a1-2e8d-4e60-af3e-c5f6ed5ff72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:34 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Volume volume-7c43066b-e067-4970-adc4-bfbb5fd559af (7c43066b-e067-4970-adc4-bfbb5fd559af): created successfully Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e757c9a1-2e8d-4e60-af3e-c5f6ed5ff72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Flow 'volume_create_manager' (8ad98cb5-7256-47de-86e1-0333077b713a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-98cf9f7a-5843-4cc2-b602-91645e5e2ef0 tempest-VolumeDependencyTests-914395665 None] Created volume successfully. Sep 07 17:01:34 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.288s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:34 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Deleted volume successfully. Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-82f3ddfb-7fd6-476f-ad8e-e6338cae0f5e tempest-ProjectReaderTests-633524117 None] Lock "cinder-f85357b8-1195-41ff-8a21-1bf78f5e029d-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:34 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD" returned: 1 in 0.423s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f257c4bb-ade4-4af4-bffb-4c2fef17baf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ade892c8fba4647b02416ea46b141f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:30Z,use_quota=True,user_id='deacc46904fe492da8134eebc36c2439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Creating volume f257c4bb-ade4-4af4-bffb-4c2fef17baf9 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:34 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:35 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 1073741824 Sep 07 17:01:35 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-d01dd222-a4e2-4d04-8952-1bc443a3d7ff-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-d01dd222-a4e2-4d04-8952-1bc443a3d7ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-quobyte-ed14aa03-075a-4fff-9df1-d22daf96edca" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-ed14aa03-075a-4fff-9df1-d22daf96edca" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-quobyte-d01dd222-a4e2-4d04-8952-1bc443a3d7ff" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-d01dd222-a4e2-4d04-8952-1bc443a3d7ff" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Deleting offline snapshot d01dd222-a4e2-4d04-8952-1bc443a3d7ff of volume ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] snapshot_file for this snap is: volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5165fb56-07c1-4808-8fd5-352c5e50cd84]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:35 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 1073741824" returned: 0 in 0.599s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:35 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 Sep 07 17:01:35 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:35 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff Sep 07 17:01:35 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:35 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9" returned: 0 in 0.361s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (6afd854f-f266-488c-a209-8ff4059733d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:36 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4628390-84b7-4b6d-b016-700452371d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff" returned: 0 in 0.507s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed14aa03-075a-4fff-9df1-d22daf96edca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Attempting download of e3c8dbff-690f-4b93-9e28-aa933c723052 ((None, [{'url': 'file:///opt/stack/data/glance/images/e3c8dbff-690f-4b93-9e28-aa933c723052', 'metadata': {}}])) to volume f257c4bb-ade4-4af4-bffb-4c2fef17baf9. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4628390-84b7-4b6d-b016-700452371d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408049025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c34b81-39fa-4440-be8f-bbbd53245ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:36Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec501e6-40b1-4baa-b743-6d89029535cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec501e6-40b1-4baa-b743-6d89029535cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf4bf80-f5ff-4425-9373-728ed9beaa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf4bf80-f5ff-4425-9373-728ed9beaa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c34b81-39fa-4440-be8f-bbbd53245ada', 'volume_name': 'volume-d4c34b81-39fa-4440-be8f-bbbd53245ada', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fccb5df-94dd-48d7-b0f3-8e3335e37543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fccb5df-94dd-48d7-b0f3-8e3335e37543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6621a6e2-80c2-4bc6-a072-75879a30dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:36 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Volume d4c34b81-39fa-4440-be8f-bbbd53245ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c34b81-39fa-4440-be8f-bbbd53245ada', 'volume_size': 1} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408049025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c34b81-39fa-4440-be8f-bbbd53245ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:36Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Creating volume d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:36 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d7a60-5359-41be-9281-67c0f7b8a23f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:36 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada 1073741824 Sep 07 17:01:36 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ff6f1d-a026-417f-9499-ea2518b63ec8]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e3c8dbff-690f-4b93-9e28-aa933c723052_5mqn6_nz {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:36 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca Sep 07 17:01:36 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:36 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e3c8dbff-690f-4b93-9e28-aa933c723052_5mqn6_nz Sep 07 17:01:36 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:36 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e3c8dbff-690f-4b93-9e28-aa933c723052_5mqn6_nz" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3c8dbff-690f-4b93-9e28-aa933c723052_5mqn6_nz {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:36 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada 1073741824" returned: 0 in 0.590s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:36 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3c8dbff-690f-4b93-9e28-aa933c723052_5mqn6_nz Sep 07 17:01:36 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:36 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada Sep 07 17:01:36 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:36 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca" returned: 0 in 0.792s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:37 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3c8dbff-690f-4b93-9e28-aa933c723052_5mqn6_nz" returned: 1 in 0.380s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e3c8dbff-690f-4b93-9e28-aa933c723052_5mqn6_nz' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[619707b7-e8e8-4f40-bea8-68bfd174b8d0]: (4, 'raw') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:37 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada" returned: 0 in 0.318s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6621a6e2-80c2-4bc6-a072-75879a30dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c34b81-39fa-4440-be8f-bbbd53245ada', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449f94d7-96c5-4d47-a9ab-6b0657f07c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:37 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Volume volume-d4c34b81-39fa-4440-be8f-bbbd53245ada (d4c34b81-39fa-4440-be8f-bbbd53245ada): created successfully Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449f94d7-96c5-4d47-a9ab-6b0657f07c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (6afd854f-f266-488c-a209-8ff4059733d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:37 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD Sep 07 17:01:37 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1484ac1a-a098-4a0e-bb15-c4f15c1da555 tempest-ProjectReaderTests-633524117 None] Created volume successfully. Sep 07 17:01:37 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff" returned: 0 in 0.397s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:37 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff Sep 07 17:01:37 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:37 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:37 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD Sep 07 17:01:37 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:37 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca.d01dd222-a4e2-4d04-8952-1bc443a3d7ff" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-d01dd222-a4e2-4d04-8952-1bc443a3d7ff" released by "_delete_snapshot" :: held 2.233s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-ed14aa03-075a-4fff-9df1-d22daf96edca" released by "delete_snapshot" :: held 2.273s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Created reservations ['0e1d66cc-d6df-4204-abcf-6a6cc412089e', '9d69e17c-e0f9-4807-8684-77737d53f2c9', '9c9cb7d4-2f08-4e6d-af26-6033a03b23a7', '34e631b0-8b13-41e1-b97d-eafd27cb2a39'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:37 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] e3c8dbff-690f-4b93-9e28-aa933c723052 was raw, converting to qcow2 {{(pid=87492) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:37 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 Sep 07 17:01:37 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Delete snapshot completed successfully. Sep 07 17:01:37 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4ef2d34d-420a-4d3f-bbf6-c0eb35142b16 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-d01dd222-a4e2-4d04-8952-1bc443a3d7ff-delete_snapshot" released by "delete_snapshot" :: held 2.540s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Creating offline snapshot 15081053-0abd-4ef3-a597-341a036f7929 of volume d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ba0f2-4b1f-40a5-bb67-ee78bee52594]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:38 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9" returned: 0 in 0.637s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e3c8dbff-690f-4b93-9e28-aa933c723052_6bi4rpjjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:01:38 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:38 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada Sep 07 17:01:38 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:38 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 1G Sep 07 17:01:38 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-ed14aa03-075a-4fff-9df1-d22daf96edca-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:38 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada" returned: 0 in 0.506s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-ed14aa03-075a-4fff-9df1-d22daf96edca-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:38 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 1G Sep 07 17:01:38 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-quobyte-ed14aa03-075a-4fff-9df1-d22daf96edca" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-ed14aa03-075a-4fff-9df1-d22daf96edca" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:38 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 1G" returned: 0 in 0.454s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Downloaded image e3c8dbff-690f-4b93-9e28-aa933c723052 ((None, [{'url': 'file:///opt/stack/data/glance/images/e3c8dbff-690f-4b93-9e28-aa933c723052', 'metadata': {}}])) to volume f257c4bb-ade4-4af4-bffb-4c2fef17baf9 successfully. {{(pid=87492) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Temporary image e3c8dbff-690f-4b93-9e28-aa933c723052 for user deacc46904fe492da8134eebc36c2439 is deleted. {{(pid=87492) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.volume.volume_utils [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Marking volume f257c4bb-ade4-4af4-bffb-4c2fef17baf9 as bootable. {{(pid=87492) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Copying metadata from image e3c8dbff-690f-4b93-9e28-aa933c723052 to f257c4bb-ade4-4af4-bffb-4c2fef17baf9. {{(pid=87492) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:01:38 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Creating volume glance metadata for volume f257c4bb-ade4-4af4-bffb-4c2fef17baf9 backed by image e3c8dbff-690f-4b93-9e28-aa933c723052 with: {'image_id': 'e3c8dbff-690f-4b93-9e28-aa933c723052', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '602d12f29023f69dde86ddc4286349fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87492) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e96ae-f7c8-49ae-9843-00be37859d77]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31eb4ec-cb94-46cd-a50a-85df9a63b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9', 'volume_size': 1, 'image_id': 'e3c8dbff-690f-4b93-9e28-aa933c723052', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e3c8dbff-690f-4b93-9e28-aa933c723052', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '602d12f29023f69dde86ddc4286349fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ade892c8fba4647b02416ea46b141f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7c75124b7a507de6fef9c1638410ea81611b9c5569b3ac8b603bb144533a9b4f50b2751d18adeff3a6097a5df04bca7955e7d4e2d0b92aad04397967491dfbd6', 'id': 'e3c8dbff-690f-4b93-9e28-aa933c723052', 'created_at': datetime.datetime(2026, 9, 7, 15, 1, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 1, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e3c8dbff-690f-4b93-9e28-aa933c723052/file', 'properties': {}}, 'image_service': }' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dc5829-3f0f-46d2-9782-bcb265b13b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:39 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Volume volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 (f257c4bb-ade4-4af4-bffb-4c2fef17baf9): created successfully Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47dc5829-3f0f-46d2-9782-bcb265b13b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Flow 'volume_create_manager' (9dff8771-277b-4059-b1ba-49fe0e35fb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e7cb64a4-381b-4dd5-80fe-ef2bb9407fa9 tempest-VolumeImageDependencyTests-1540808335 None] Created volume successfully. Sep 07 17:01:39 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca Sep 07 17:01:39 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:39 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 1G" returned: 0 in 0.541s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4c34b81-39fa-4440-be8f-bbbd53245ada -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:39 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4c34b81-39fa-4440-be8f-bbbd53245ada -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 Sep 07 17:01:39 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:39 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca" returned: 0 in 0.488s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:39 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca Sep 07 17:01:39 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:39 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4c34b81-39fa-4440-be8f-bbbd53245ada -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929" returned: 0 in 0.326s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:39 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 is being set with open permissions: ugo+rw Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:39 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 Sep 07 17:01:39 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:39 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-ed14aa03-075a-4fff-9df1-d22daf96edca" returned: 0 in 0.296s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-ed14aa03-075a-4fff-9df1-d22daf96edca" released by "delete_volume" :: held 0.867s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:39 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Created reservations ['57f89dff-06f6-4ede-b728-90f6504b8875', '3a13178d-88d5-4425-b38c-c928a069a53a', 'e05773f3-a8a7-4e20-8bc9-82c8dca37771', 'fdf2682c-96f6-4a95-8bd4-d54248f9dda0'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Acquiring lock "cinder-f257c4bb-ade4-4af4-bffb-4c2fef17baf9-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:40 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:40 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929" returned: 0 in 0.317s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Lock "cinder-f257c4bb-ade4-4af4-bffb-4c2fef17baf9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-7c43066b-e067-4970-adc4-bfbb5fd559af-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.info Sep 07 17:01:40 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-7c43066b-e067-4970-adc4-bfbb5fd559af-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Acquiring lock "cinder-quobyte-f257c4bb-ade4-4af4-bffb-4c2fef17baf9" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Lock "cinder-quobyte-f257c4bb-ade4-4af4-bffb-4c2fef17baf9" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "cinder-quobyte-7c43066b-e067-4970-adc4-bfbb5fd559af" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac21cc8b-a308-4187-8c0e-ad97cfe0a2b8]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-7c43066b-e067-4970-adc4-bfbb5fd559af" acquired by "delete_volume" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25a7125-6183-46f4-a0b3-859e6d01c0be]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.378s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Deleted volume successfully. Sep 07 17:01:40 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 Sep 07 17:01:40 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d38c3bfe-f797-45d1-9452-95288c468c01 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-ed14aa03-075a-4fff-9df1-d22daf96edca-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:40 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af Sep 07 17:01:40 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.info" returned: 0 in 0.513s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.info is being set with open permissions: ugo+rw Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.info Sep 07 17:01:40 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9" returned: 0 in 0.507s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9 Sep 07 17:01:40 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af" returned: 0 in 0.532s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af Sep 07 17:01:40 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.info" returned: 0 in 0.302s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-474a8be7-b6ea-4d49-947c-c9f1426c6e9a tempest-ProjectReaderTests-633524117 None] Create snapshot completed successfully Sep 07 17:01:41 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-f257c4bb-ade4-4af4-bffb-4c2fef17baf9" returned: 0 in 0.284s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Lock "cinder-quobyte-f257c4bb-ade4-4af4-bffb-4c2fef17baf9" released by "delete_volume" :: held 0.844s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Created reservations ['d822ec28-b887-4e88-8e18-6a2cd8121d26', '01d893c8-d429-4cc6-8396-ab9acc775af3', '2c22dc88-7f4e-40d8-a157-76005df50d8d', 'b7af3582-6aba-4f7a-a02a-707200780dc9'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:41 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-7c43066b-e067-4970-adc4-bfbb5fd559af" returned: 0 in 0.340s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-quobyte-7c43066b-e067-4970-adc4-bfbb5fd559af" released by "delete_volume" :: held 0.931s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:41 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:41 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Created reservations ['80f1a755-1dcf-45e7-a4c3-a0b80e0613e9', '62da3d21-2399-42b3-8d17-d04e6eae358a', '36355b7e-023f-44b1-83af-404b489cd64c', 'aec79915-cd33-4ed0-846d-658726b965a0'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:41 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:41 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-15081053-0abd-4ef3-a597-341a036f7929-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:41 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Lock "cinder-15081053-0abd-4ef3-a597-341a036f7929-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-d4c34b81-39fa-4440-be8f-bbbd53245ada" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.459s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Deleted volume successfully. Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-d4c34b81-39fa-4440-be8f-bbbd53245ada" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-15081053-0abd-4ef3-a597-341a036f7929" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-738279ce-8946-4fcf-870d-ad589249c642 tempest-VolumeImageDependencyTests-1540808335 None] Lock "cinder-f257c4bb-ade4-4af4-bffb-4c2fef17baf9-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-15081053-0abd-4ef3-a597-341a036f7929" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Deleting offline snapshot 15081053-0abd-4ef3-a597-341a036f7929 of volume d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] snapshot_file for this snap is: volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[914bca78-edc6-4c67-8935-08098c3b83bb]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:41 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.468s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:41 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:41 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Deleted volume successfully. Sep 07 17:01:42 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2316951-e6e7-4774-8c26-d62cdec52c83 tempest-VolumeDependencyTests-914395665 None] Lock "cinder-7c43066b-e067-4970-adc4-bfbb5fd559af-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:42 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 Sep 07 17:01:42 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:42 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929" returned: 0 in 0.406s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4c34b81-39fa-4440-be8f-bbbd53245ada(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2934b53d-cf04-463b-b939-52d45afb5d07]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:42 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada Sep 07 17:01:42 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:42 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada" returned: 0 in 0.459s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:42 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 Sep 07 17:01:42 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:43 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929" returned: 0 in 0.445s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:43 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929 Sep 07 17:01:43 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:43 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada.15081053-0abd-4ef3-a597-341a036f7929" returned: 0 in 0.347s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-15081053-0abd-4ef3-a597-341a036f7929" released by "_delete_snapshot" :: held 1.829s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-d4c34b81-39fa-4440-be8f-bbbd53245ada" released by "delete_snapshot" :: held 1.889s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Created reservations ['c4fe4432-8210-4143-b892-1dbed7803d75', 'a0ec3d22-a759-4252-a374-bd700fbfe464', 'c4692d05-3d95-4c6c-9470-0837189968a1', '2adc1ab6-dbb9-477e-8ed3-2e629974a596'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Delete snapshot completed successfully. Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0091f5bf-3312-4569-aea3-a97bdfade060 tempest-ProjectReaderTests-633524117 None] Lock "cinder-15081053-0abd-4ef3-a597-341a036f7929-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-d4c34b81-39fa-4440-be8f-bbbd53245ada-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Lock "cinder-d4c34b81-39fa-4440-be8f-bbbd53245ada-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-d4c34b81-39fa-4440-be8f-bbbd53245ada" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-d4c34b81-39fa-4440-be8f-bbbd53245ada" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f493286e-66fc-4c79-b713-ad26445c9bd1]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:44 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada Sep 07 17:01:44 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:44 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada" returned: 0 in 0.516s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:44 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada Sep 07 17:01:44 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:44 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-d4c34b81-39fa-4440-be8f-bbbd53245ada" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-d4c34b81-39fa-4440-be8f-bbbd53245ada" released by "delete_volume" :: held 0.889s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Created reservations ['b1be55c4-7218-459c-b7f0-6f1697938675', 'cf8ef383-2767-4f95-a82c-0bda304483e1', 'b7b987b4-7d7b-4864-854a-0c9a1dbf9d3e', '623b8347-82c5-42f4-9a3b-2399a118a8bf'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:45 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:45 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:45 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.312s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Deleted volume successfully. Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b32c1a7c-ffdd-400c-9743-8fca4484da77 tempest-ProjectReaderTests-633524117 None] Lock "cinder-d4c34b81-39fa-4440-be8f-bbbd53245ada-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (a0b4773b-4b80-4da4-9e2f-0a89a1838983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c89b813-9444-4d76-8d93-49649a0a6142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c89b813-9444-4d76-8d93-49649a0a6142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610785658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b9cfdf-a469-4040-8d26-844624bf9913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:46Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c6838-04ce-4018-b576-e8f5a350d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13c6838-04ce-4018-b576-e8f5a350d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdefbbb1-b167-4511-908e-bdbae7b9357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdefbbb1-b167-4511-908e-bdbae7b9357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b9cfdf-a469-4040-8d26-844624bf9913', 'volume_name': 'volume-17b9cfdf-a469-4040-8d26-844624bf9913', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcd3a16-b21a-4c2f-857b-9faad06b995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcd3a16-b21a-4c2f-857b-9faad06b995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2903d552-f11c-4e07-9d86-6bf722c0ff65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:45 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Volume 17b9cfdf-a469-4040-8d26-844624bf9913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b9cfdf-a469-4040-8d26-844624bf9913', 'volume_size': 1} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610785658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b9cfdf-a469-4040-8d26-844624bf9913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea07c66de943bba2c3b154f77e4d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:46Z,use_quota=True,user_id='113ce9d8ace5464c9639183fcc8f8fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Creating volume 17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:45 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:45 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 1073741824 Sep 07 17:01:45 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:46 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 1073741824" returned: 0 in 0.512s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:46 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 Sep 07 17:01:46 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:46 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913" returned: 0 in 0.310s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2903d552-f11c-4e07-9d86-6bf722c0ff65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b9cfdf-a469-4040-8d26-844624bf9913', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce13d21-38b0-4a36-9f50-76ab12c0c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:46 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Volume volume-17b9cfdf-a469-4040-8d26-844624bf9913 (17b9cfdf-a469-4040-8d26-844624bf9913): created successfully Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce13d21-38b0-4a36-9f50-76ab12c0c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Flow 'volume_create_manager' (a0b4773b-4b80-4da4-9e2f-0a89a1838983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-038067b9-5817-4d8d-ad9d-2133abc4aa8d tempest-ProjectReaderTests-633524117 None] Created volume successfully. Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=333,cinder:SELECT=228,cinder:INSERT=87,cinder:DELETE=31 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Flow 'volume_create_manager' (e650ec15-c5de-40c0-aef9-403b9e5a182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9116d96c-69ff-4cf3-a0d5-592e172385e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=246,cinder:UPDATE=314,cinder:INSERT=88,cinder:DELETE=26 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9116d96c-69ff-4cf3-a0d5-592e172385e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a38cb9-1b25-4664-a1bf-0da14f0d0194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4165809f6d2c40c5acceaaddcdffcdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:48Z,use_quota=True,user_id='27905b8ea646430aadf5c55ddbfd5593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09160a7-6d63-49a0-837c-853b4dd4578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c09160a7-6d63-49a0-837c-853b4dd4578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94047b9-4b27-4394-bc1a-04400eeff5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94047b9-4b27-4394-bc1a-04400eeff5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a38cb9-1b25-4664-a1bf-0da14f0d0194', 'volume_name': 'volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ff6d10-0325-4fb9-88ab-fff4cb69c34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ff6d10-0325-4fb9-88ab-fff4cb69c34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ca43f2-8e68-48fa-b3e8-eae1bb814d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:47 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Volume e2a38cb9-1b25-4664-a1bf-0da14f0d0194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194', 'volume_size': 1} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a38cb9-1b25-4664-a1bf-0da14f0d0194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4165809f6d2c40c5acceaaddcdffcdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:48Z,use_quota=True,user_id='27905b8ea646430aadf5c55ddbfd5593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Creating volume e2a38cb9-1b25-4664-a1bf-0da14f0d0194 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:47 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:47 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 1073741824 Sep 07 17:01:47 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:48 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 1073741824" returned: 0 in 0.568s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:48 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 Sep 07 17:01:48 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:48 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194" returned: 0 in 0.255s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.459s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ca43f2-8e68-48fa-b3e8-eae1bb814d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032c02aa-3c19-462f-a60e-4b199691a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Creating offline snapshot 564893aa-454e-4f89-83cf-b85cdfe9f7e2 of volume 17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:48 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Volume volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 (e2a38cb9-1b25-4664-a1bf-0da14f0d0194): created successfully Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032c02aa-3c19-462f-a60e-4b199691a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Flow 'volume_create_manager' (e650ec15-c5de-40c0-aef9-403b9e5a182e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7eb2b3-b649-4026-b5d0-f73ebf30ca7a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4456a1a6-4bc1-4cc3-b5e6-f70ce65c4aca tempest-CinderUnicodeTest-1933270443 None] Created volume successfully. Sep 07 17:01:48 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 Sep 07 17:01:48 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:49 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913" returned: 0 in 0.390s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:49 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 1G Sep 07 17:01:49 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:49 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 1G" returned: 0 in 0.504s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b9cfdf-a469-4040-8d26-844624bf9913 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:49 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b9cfdf-a469-4040-8d26-844624bf9913 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 Sep 07 17:01:49 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:49 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b9cfdf-a469-4040-8d26-844624bf9913 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2" returned: 0 in 0.351s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:49 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 is being set with open permissions: ugo+rw Sep 07 17:01:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:49 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 Sep 07 17:01:49 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:50 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2" returned: 0 in 0.262s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:50 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.info Sep 07 17:01:50 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:50 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.info" returned: 0 in 0.324s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:50 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.info is being set with open permissions: ugo+rw Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:50 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.info Sep 07 17:01:50 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (2109db4f-cfb1-492a-ad02-6e564b407234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd990bf-95a6-4da7-b277-8c681394269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd990bf-95a6-4da7-b277-8c681394269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700444061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857fe5a5-cf52-4c5a-acdd-bb5304a927c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:51Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77305908-498e-4b01-937d-150eaabccd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77305908-498e-4b01-937d-150eaabccd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cffe1f9-933a-4aa1-991f-63378fdc404b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cffe1f9-933a-4aa1-991f-63378fdc404b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '857fe5a5-cf52-4c5a-acdd-bb5304a927c6', 'volume_name': 'volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7064158-52c5-4cbf-b5fe-4ab6b976ac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7064158-52c5-4cbf-b5fe-4ab6b976ac59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6991575-bf07-43bf-bd20-c0dc476d26f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Volume 857fe5a5-cf52-4c5a-acdd-bb5304a927c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6', 'volume_size': 1} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Flow 'volume_create_manager' (9f5463b7-314e-480b-9cc0-9835b6747e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71449db8-446a-484b-a0ef-9124e024e0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71449db8-446a-484b-a0ef-9124e024e0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1798930620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a10878-561d-4b2c-a2aa-bb6b90e0a192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4165809f6d2c40c5acceaaddcdffcdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:51Z,use_quota=True,user_id='27905b8ea646430aadf5c55ddbfd5593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4169bda-9efd-4128-9215-60eb27465948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4169bda-9efd-4128-9215-60eb27465948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f79e05a-6120-4d32-ab87-10de44260126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f79e05a-6120-4d32-ab87-10de44260126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a10878-561d-4b2c-a2aa-bb6b90e0a192', 'volume_name': 'volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca2d7f1-9591-4239-928b-5cec0d403f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca2d7f1-9591-4239-928b-5cec0d403f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa13c122-5a21-482e-a5b0-a1e1858e85bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:50 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Volume 44a10878-561d-4b2c-a2aa-bb6b90e0a192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192', 'volume_size': 1} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:50 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.info" returned: 0 in 0.434s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.202s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700444061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857fe5a5-cf52-4c5a-acdd-bb5304a927c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:51Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Creating volume 857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:50 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:51 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 1073741824 Sep 07 17:01:51 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:51 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fb27f3e6-ee8f-462c-aeca-a6ae98fe31eb tempest-ProjectReaderTests-633524117 None] Create snapshot completed successfully Sep 07 17:01:51 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 1073741824" returned: 0 in 0.517s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:51 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 Sep 07 17:01:51 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-564893aa-454e-4f89-83cf-b85cdfe9f7e2-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Lock "cinder-564893aa-454e-4f89-83cf-b85cdfe9f7e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-17b9cfdf-a469-4040-8d26-844624bf9913" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-17b9cfdf-a469-4040-8d26-844624bf9913" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-564893aa-454e-4f89-83cf-b85cdfe9f7e2" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-564893aa-454e-4f89-83cf-b85cdfe9f7e2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Deleting offline snapshot 564893aa-454e-4f89-83cf-b85cdfe9f7e2 of volume 17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] snapshot_file for this snap is: volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0279a6-c65e-4cf0-ad8c-d11a6472d636]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:51 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" returned: 0 in 0.370s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1798930620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a10878-561d-4b2c-a2aa-bb6b90e0a192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4165809f6d2c40c5acceaaddcdffcdd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:51Z,use_quota=True,user_id='27905b8ea646430aadf5c55ddbfd5593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Creating volume 44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:51 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6991575-bf07-43bf-bd20-c0dc476d26f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:51 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 1073741824 Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536ad277-a117-4a84-aab2-0ad351e8547e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:51 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:51 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 Sep 07 17:01:51 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Volume volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 (857fe5a5-cf52-4c5a-acdd-bb5304a927c6): created successfully Sep 07 17:01:51 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536ad277-a117-4a84-aab2-0ad351e8547e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:51 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (2109db4f-cfb1-492a-ad02-6e564b407234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-3ceea969-ea73-48b7-a957-224d5ca2c433 tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:01:52 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2" returned: 0 in 0.370s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b9cfdf-a469-4040-8d26-844624bf9913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03abd9f-aeed-4e69-95dc-da8b9ee3995e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:52 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:52 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 Sep 07 17:01:52 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 1073741824" returned: 0 in 0.438s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:52 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 Sep 07 17:01:52 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:52 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913" returned: 0 in 0.385s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:52 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:52 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 Sep 07 17:01:52 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192" returned: 0 in 0.279s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa13c122-5a21-482e-a5b0-a1e1858e85bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd69aa33-f280-4e18-ae7b-a20fbbe972fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:52 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Volume volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 (44a10878-561d-4b2c-a2aa-bb6b90e0a192): created successfully Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd69aa33-f280-4e18-ae7b-a20fbbe972fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Flow 'volume_create_manager' (9f5463b7-314e-480b-9cc0-9835b6747e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d9faac12-663b-498b-8dfe-7680c847c8e7 tempest-CinderUnicodeTest-1933270443 None] Created volume successfully. Sep 07 17:01:53 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2" returned: 0 in 0.479s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:53 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2 Sep 07 17:01:53 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Creating offline snapshot fa3a6a70-50cf-4d73-a3dc-43f9888105c2 of volume 44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:53 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913.564893aa-454e-4f89-83cf-b85cdfe9f7e2" returned: 0 in 0.359s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f4e3d2-8eba-4488-8e03-a8bd2ba89f8f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-564893aa-454e-4f89-83cf-b85cdfe9f7e2" released by "_delete_snapshot" :: held 1.708s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-17b9cfdf-a469-4040-8d26-844624bf9913" released by "delete_snapshot" :: held 1.748s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Created reservations ['23504d2d-8c32-4112-9fe3-102dc4707a5f', 'f7ddb2d8-c6b3-46bc-befd-7b0e9910c1be', 'b859f97c-abfc-43dc-83c6-b31302c68523', '0bddc069-82a2-45af-823f-d8d6f74cb2a6'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:53 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 Sep 07 17:01:53 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Delete snapshot completed successfully. Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-d603f93c-ed27-43b7-a656-9ffe3b6a5dde tempest-ProjectReaderTests-633524117 None] Lock "cinder-564893aa-454e-4f89-83cf-b85cdfe9f7e2-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:53 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192" returned: 0 in 0.452s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:53 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 1G Sep 07 17:01:53 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-17b9cfdf-a469-4040-8d26-844624bf9913-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Lock "cinder-17b9cfdf-a469-4040-8d26-844624bf9913-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Acquiring lock "cinder-quobyte-17b9cfdf-a469-4040-8d26-844624bf9913" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-17b9cfdf-a469-4040-8d26-844624bf9913" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[271337f2-f318-47ac-979e-a11fcba42f2f]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:54 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 Sep 07 17:01:54 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 1G" returned: 0 in 0.535s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:54 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 Sep 07 17:01:54 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913" returned: 0 in 0.466s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:54 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913 Sep 07 17:01:54 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2" returned: 0 in 0.358s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 is being set with open permissions: ugo+rw Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:54 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 Sep 07 17:01:54 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-17b9cfdf-a469-4040-8d26-844624bf9913" returned: 0 in 0.295s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Lock "cinder-quobyte-17b9cfdf-a469-4040-8d26-844624bf9913" released by "delete_volume" :: held 0.841s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:54 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Created reservations ['b20dfcd6-bcbf-432b-b0d8-bb4cfa87a789', '6e3f31dd-8bd1-4781-91a3-5c149b5bb868', '272d5807-5eda-46a4-ab7d-0eab86e672d5', '3b1cf018-5572-47df-94a6-f9286f829720'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:55 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:01:55 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:55 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2" returned: 0 in 0.260s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:55 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.info Sep 07 17:01:55 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:55 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.299s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Deleted volume successfully. Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f456fe20-b96f-46e9-a900-5a853f09cb06 tempest-ProjectReaderTests-633524117 None] Lock "cinder-17b9cfdf-a469-4040-8d26-844624bf9913-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:55 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.info" returned: 0 in 0.338s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:55 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.info is being set with open permissions: ugo+rw Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:55 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.info Sep 07 17:01:55 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:55 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.info" returned: 0 in 0.312s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.313s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 0f6fee79-4ea2-4733-a10c-d76d25e36c25 of volume 857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a4898387-635b-4f83-8f5b-9248107df56b tempest-CinderUnicodeTest-1933270443 None] Create snapshot completed successfully Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927551d-e881-4b94-94a7-a5a25f210f48]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:56 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 Sep 07 17:01:56 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:56 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:56 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 1G Sep 07 17:01:56 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "cinder-fa3a6a70-50cf-4d73-a3dc-43f9888105c2-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-fa3a6a70-50cf-4d73-a3dc-43f9888105c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "cinder-quobyte-44a10878-561d-4b2c-a2aa-bb6b90e0a192" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-44a10878-561d-4b2c-a2aa-bb6b90e0a192" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "cinder-quobyte-fa3a6a70-50cf-4d73-a3dc-43f9888105c2" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-fa3a6a70-50cf-4d73-a3dc-43f9888105c2" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Deleting offline snapshot fa3a6a70-50cf-4d73-a3dc-43f9888105c2 of volume 44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] snapshot_file for this snap is: volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c6647-5a04-4dc0-a093-5cd15717923b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:56 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 1G" returned: 0 in 0.545s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:56 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 Sep 07 17:01:56 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:56 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 Sep 07 17:01:56 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:57 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25" returned: 0 in 0.345s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:57 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 is being set with open permissions: ugo+rw Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:57 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 Sep 07 17:01:57 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:57 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2" returned: 0 in 0.529s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[1618c6a8-1327-4f03-90d8-414258cc8c45]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:57 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 Sep 07 17:01:57 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:57 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25" returned: 0 in 0.323s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:57 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.info Sep 07 17:01:57 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:57 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192" returned: 0 in 0.473s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:57 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 Sep 07 17:01:57 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:57 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.info" returned: 0 in 0.349s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:57 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.info is being set with open permissions: ugo+rw Sep 07 17:01:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:57 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.info Sep 07 17:01:57 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:58 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.info" returned: 0 in 0.300s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-1bbb2fd4-8b4f-41f0-b8cd-74383c6f2e31 tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:01:58 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2" returned: 0 in 0.468s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:58 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2 Sep 07 17:01:58 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:58 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192.fa3a6a70-50cf-4d73-a3dc-43f9888105c2" returned: 0 in 0.319s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-0f6fee79-4ea2-4733-a10c-d76d25e36c25-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-fa3a6a70-50cf-4d73-a3dc-43f9888105c2" released by "_delete_snapshot" :: held 1.940s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-44a10878-561d-4b2c-a2aa-bb6b90e0a192" released by "delete_snapshot" :: held 1.978s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Lock "cinder-0f6fee79-4ea2-4733-a10c-d76d25e36c25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-0f6fee79-4ea2-4733-a10c-d76d25e36c25" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-0f6fee79-4ea2-4733-a10c-d76d25e36c25" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 0f6fee79-4ea2-4733-a10c-d76d25e36c25 of volume 857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed76d3-7f47-43e1-9efb-2cc4222ddee3]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Created reservations ['77a96557-fa63-4849-bed9-1f0a04ebfd60', '34dde7ef-7372-4274-a8f5-0649e8cde500', 'f724a7ee-ba0c-4181-80ce-95d39eed121b', '78f5ea81-7a73-4436-8828-9879346ca756'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:58 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Delete snapshot completed successfully. Sep 07 17:01:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-5dca25b6-0efb-4e22-92ba-766811bcabe7 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-fa3a6a70-50cf-4d73-a3dc-43f9888105c2-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:58 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 Sep 07 17:01:58 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:59 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e0b4e4-1840-4992-866c-4deb1f8a903b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:59 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 Sep 07 17:01:59 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:59 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" returned: 0 in 0.419s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:59 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 Sep 07 17:01:59 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "cinder-44a10878-561d-4b2c-a2aa-bb6b90e0a192-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-44a10878-561d-4b2c-a2aa-bb6b90e0a192-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "cinder-quobyte-44a10878-561d-4b2c-a2aa-bb6b90e0a192" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-44a10878-561d-4b2c-a2aa-bb6b90e0a192" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4744312c-a250-4108-b7fc-bc1f450424d4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:00 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25" returned: 0 in 0.500s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:00 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 Sep 07 17:02:00 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:00 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25 Sep 07 17:02:00 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:00 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6.0f6fee79-4ea2-4733-a10c-d76d25e36c25" returned: 0 in 0.279s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:00 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192" returned: 0 in 0.418s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:00 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192 Sep 07 17:02:00 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-0f6fee79-4ea2-4733-a10c-d76d25e36c25" released by "_delete_snapshot" :: held 1.764s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" released by "delete_snapshot" :: held 1.804s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Created reservations ['ee20ba90-2a3d-48ac-96d7-07af6dd7ca3a', 'fb0eb533-b197-4886-9702-0e9b5dbda118', 'af73f6fd-63cb-4bb3-a474-fb6183907cd8', 'fb18d4b1-c071-4d67-af70-e0fde8439c18'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-14a68828-1cc0-4c8b-96ce-a93b21b85d24 tempest-ProjectMemberTests-775595433 None] Lock "cinder-0f6fee79-4ea2-4733-a10c-d76d25e36c25-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:00 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-44a10878-561d-4b2c-a2aa-bb6b90e0a192" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-44a10878-561d-4b2c-a2aa-bb6b90e0a192" released by "delete_volume" :: held 0.746s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Created reservations ['7799d0a2-1546-427d-91a0-8b52eb13778b', 'f857e6e7-5e80-423a-8834-0fe95b551c6c', '5f5a2bcc-41b8-47ae-9fe7-a4c7fc8c124c', '22833112-00c8-4de1-b699-afcd42801827'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-857fe5a5-cf52-4c5a-acdd-bb5304a927c6-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Lock "cinder-857fe5a5-cf52-4c5a-acdd-bb5304a927c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:00 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" acquired by "delete_volume" :: waited 0.024s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70029d2-b27d-43cc-967e-ffd51ba4421a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:01 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:01 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "cinder-e2a38cb9-1b25-4664-a1bf-0da14f0d0194-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-e2a38cb9-1b25-4664-a1bf-0da14f0d0194-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:01 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 Sep 07 17:02:01 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "cinder-quobyte-e2a38cb9-1b25-4664-a1bf-0da14f0d0194" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-e2a38cb9-1b25-4664-a1bf-0da14f0d0194" acquired by "delete_volume" :: waited 0.029s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a96b7-ab68-4247-ac1f-2745378b5715]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:01 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.468s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:01 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 Sep 07 17:02:01 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:01 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Deleted volume successfully. Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-05a37a8b-9083-48ac-9728-619e92767924 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-44a10878-561d-4b2c-a2aa-bb6b90e0a192-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:01 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" returned: 0 in 0.610s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:01 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6 Sep 07 17:02:01 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:01 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194" returned: 0 in 0.575s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:01 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:01 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194 Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" returned: 0 in 0.293s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:01 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:01 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-857fe5a5-cf52-4c5a-acdd-bb5304a927c6" released by "delete_volume" :: held 0.990s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Created reservations ['a733a121-9612-4769-ad9a-21635aa32dff', '8f2ea46d-62a3-4eb8-803b-97653d0c9427', '05ac2498-e2f9-4ddb-8c5f-8993dbd99e49', '55b58d77-a600-4e0d-ae43-c10ca66f4481'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:02 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:02 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:02 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e2a38cb9-1b25-4664-a1bf-0da14f0d0194" returned: 0 in 0.368s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-quobyte-e2a38cb9-1b25-4664-a1bf-0da14f0d0194" released by "delete_volume" :: held 1.021s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Created reservations ['c4a15738-0b7b-488f-b86e-ff69103cd132', '1bb63b09-f6d2-4b4d-8f37-ec14aa0483da', 'bb39017b-e3f6-4174-a06c-7be81a288d43', '2cd2e385-c9d8-4f32-b0d7-5eeb66eb9110'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:02 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:02 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:02 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-17d137a5-ca65-4e50-82aa-d057fa220545 tempest-ProjectMemberTests-775595433 None] Lock "cinder-857fe5a5-cf52-4c5a-acdd-bb5304a927c6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:02 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.281s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Deleted volume successfully. Sep 07 17:02:02 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9b235fb8-412a-4a64-8b2b-15b827511bf5 tempest-CinderUnicodeTest-1933270443 None] Lock "cinder-e2a38cb9-1b25-4664-a1bf-0da14f0d0194-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (1f49e66c-294a-4216-a82c-70c9febbc132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2b4da0-33f5-46fc-9256-67e8c49f4a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2b4da0-33f5-46fc-9256-67e8c49f4a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967293229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a773ea22-147f-4600-98b4-eca57a0ef1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:04Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da9e99c-5ac2-40f5-adf8-632dbc32776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da9e99c-5ac2-40f5-adf8-632dbc32776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a821600c-88a4-4640-9def-7bdbf88b83ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a821600c-88a4-4640-9def-7bdbf88b83ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a773ea22-147f-4600-98b4-eca57a0ef1f2', 'volume_name': 'volume-a773ea22-147f-4600-98b4-eca57a0ef1f2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441b660-7039-4259-859f-7afc6bbecebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b441b660-7039-4259-859f-7afc6bbecebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065677ce-2811-4577-baf6-4851a7d35655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:03 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Volume a773ea22-147f-4600-98b4-eca57a0ef1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a773ea22-147f-4600-98b4-eca57a0ef1f2', 'volume_size': 1} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967293229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a773ea22-147f-4600-98b4-eca57a0ef1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:04Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Creating volume a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:03 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:03 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 1073741824 Sep 07 17:02:03 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:04 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 1073741824" returned: 0 in 0.611s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:04 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 Sep 07 17:02:04 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:04 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2" returned: 0 in 0.487s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:04 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065677ce-2811-4577-baf6-4851a7d35655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a773ea22-147f-4600-98b4-eca57a0ef1f2', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530785ff-364b-4d40-bc1d-91513eed5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:05 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Volume volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 (a773ea22-147f-4600-98b4-eca57a0ef1f2): created successfully Sep 07 17:02:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530785ff-364b-4d40-bc1d-91513eed5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:05 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (1f49e66c-294a-4216-a82c-70c9febbc132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:05 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-89830e4b-ac08-4cc0-9aa5-32a91329a8f0 tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:02:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 855f38ac-71fb-4611-8ec4-02667b027a14 of volume a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:06 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5467f7-4042-4702-a89d-60163e907701]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:06 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 Sep 07 17:02:06 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:06 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2" returned: 0 in 0.438s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:06 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 1G Sep 07 17:02:06 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:07 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 1G" returned: 0 in 0.575s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:07 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 Sep 07 17:02:07 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:07 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14" returned: 0 in 0.448s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:07 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 is being set with open permissions: ugo+rw Sep 07 17:02:07 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:07 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 Sep 07 17:02:07 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:08 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-4c0e79b1-19d2-43af-a0ab-61ea49095cab tempest-ProjectAdminTests-1934764757 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.566562652588, 'free_capacity_gb': 1773.566562652588, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87492) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 17:02:08 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14" returned: 0 in 0.321s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:08 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.info Sep 07 17:02:08 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:08 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.info" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:08 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.info is being set with open permissions: ugo+rw Sep 07 17:02:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:08 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.info Sep 07 17:02:08 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:08 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.info" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:08 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:08 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-00dd458b-0c36-444f-9f64-c5e123a74144 tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-855f38ac-71fb-4611-8ec4-02667b027a14-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Lock "cinder-855f38ac-71fb-4611-8ec4-02667b027a14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-a773ea22-147f-4600-98b4-eca57a0ef1f2" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-a773ea22-147f-4600-98b4-eca57a0ef1f2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-855f38ac-71fb-4611-8ec4-02667b027a14" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-855f38ac-71fb-4611-8ec4-02667b027a14" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 855f38ac-71fb-4611-8ec4-02667b027a14 of volume a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b2b63d-08a2-45c4-bc69-93cad0def526]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:09 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:09 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 Sep 07 17:02:09 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:10 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14" returned: 0 in 0.457s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:10 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a773ea22-147f-4600-98b4-eca57a0ef1f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:10 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c1761-03e1-4c41-99a9-bbcdb6704055]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:10 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 Sep 07 17:02:10 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:10 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2" returned: 0 in 0.529s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:10 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:10 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 Sep 07 17:02:10 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:11 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14" returned: 0 in 0.424s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:11 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14 Sep 07 17:02:11 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:11 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2.855f38ac-71fb-4611-8ec4-02667b027a14" returned: 0 in 0.261s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-855f38ac-71fb-4611-8ec4-02667b027a14" released by "_delete_snapshot" :: held 1.821s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-a773ea22-147f-4600-98b4-eca57a0ef1f2" released by "delete_snapshot" :: held 1.855s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Created reservations ['e55a98d7-1913-48f7-af6f-5159acca19c9', '1abf6f00-6127-478c-8ecf-8c177d3c41e2', '263270c7-ba23-4355-a209-ef4ea8ad7f3f', '0d2ecc5e-2b8b-4170-9382-2f36ab38bb5b'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:11 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a5065e2d-e21f-4565-b498-e8d89b9140fd tempest-ProjectMemberTests-775595433 None] Lock "cinder-855f38ac-71fb-4611-8ec4-02667b027a14-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-a773ea22-147f-4600-98b4-eca57a0ef1f2-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:11 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Lock "cinder-a773ea22-147f-4600-98b4-eca57a0ef1f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-a773ea22-147f-4600-98b4-eca57a0ef1f2" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-a773ea22-147f-4600-98b4-eca57a0ef1f2" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b4fa7-29ef-4a93-be83-7ca7208022c8]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Flow 'volume_create_manager' (f9730acc-6ca6-4966-bc5a-2aa1f05508e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a96e258-311a-4d0b-940f-e7e32148624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a96e258-311a-4d0b-940f-e7e32148624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999433500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b883c2-a176-4e07-acc7-45040503f929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57aac0b9bd440bb9b722288987778f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:12Z,use_quota=True,user_id='b3f0c4cd083c45d99d96cb84c997b221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b9474-fb60-4490-b684-6ed70a62f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b9474-fb60-4490-b684-6ed70a62f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5973d7-12e2-47c7-9f63-f7a9eb3c5a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5973d7-12e2-47c7-9f63-f7a9eb3c5a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b883c2-a176-4e07-acc7-45040503f929', 'volume_name': 'volume-75b883c2-a176-4e07-acc7-45040503f929', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e56362-59a3-4f4b-9e04-208614167b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e56362-59a3-4f4b-9e04-208614167b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728518aa-fcd3-400e-898c-38d445da6d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:12 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Volume 75b883c2-a176-4e07-acc7-45040503f929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b883c2-a176-4e07-acc7-45040503f929', 'volume_size': 1} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999433500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b883c2-a176-4e07-acc7-45040503f929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57aac0b9bd440bb9b722288987778f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:12Z,use_quota=True,user_id='b3f0c4cd083c45d99d96cb84c997b221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Creating volume 75b883c2-a176-4e07-acc7-45040503f929 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:12 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 Sep 07 17:02:12 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:12 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:12 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 1073741824 Sep 07 17:02:12 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:12 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2" returned: 0 in 0.405s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:12 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2 Sep 07 17:02:12 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:12 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 1073741824" returned: 0 in 0.510s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:12 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-a773ea22-147f-4600-98b4-eca57a0ef1f2" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:12 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 Sep 07 17:02:12 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-a773ea22-147f-4600-98b4-eca57a0ef1f2" released by "delete_volume" :: held 0.760s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Created reservations ['232f429c-f546-48f0-8026-aa8354ccd95e', '0f5ec167-98f1-4263-80e3-0ed6c3900c82', '02bfd96d-55fd-43a6-881d-a8882b232144', 'e2745de6-e8e8-4333-b575-ca1c57be3ecd'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:12 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:12 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:12 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:13 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929" returned: 0 in 0.322s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728518aa-fcd3-400e-898c-38d445da6d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b883c2-a176-4e07-acc7-45040503f929', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c531d8-2d21-4358-b981-8aa7c12512e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Volume volume-75b883c2-a176-4e07-acc7-45040503f929 (75b883c2-a176-4e07-acc7-45040503f929): created successfully Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c531d8-2d21-4358-b981-8aa7c12512e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Flow 'volume_create_manager' (f9730acc-6ca6-4966-bc5a-2aa1f05508e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-430348cb-e601-44d4-8a68-23bcc691e77d tempest-ProjectReaderTests-513735808 None] Created volume successfully. Sep 07 17:02:13 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.267s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:13 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-7c5e1030-a0a1-40eb-a7d5-b198af6aca31 tempest-ProjectMemberTests-775595433 None] Lock "cinder-a773ea22-147f-4600-98b4-eca57a0ef1f2-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (81095cfc-2c4f-4f68-aec2-f696755815b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43383c9-45e1-4fc4-8c13-2caa055b0e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43383c9-45e1-4fc4-8c13-2caa055b0e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1228896517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d1f3f3-b82f-44f3-af93-bd924a8a0f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:14Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dbf6ff-0270-4972-97b6-611d4e29458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dbf6ff-0270-4972-97b6-611d4e29458e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca16e90-9f9e-4c9f-90d2-0f37c469d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca16e90-9f9e-4c9f-90d2-0f37c469d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d1f3f3-b82f-44f3-af93-bd924a8a0f6a', 'volume_name': 'volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1813925-ff09-4dd3-b165-740dbf171aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1813925-ff09-4dd3-b165-740dbf171aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18d095e-306e-4a72-ba39-871d332ad2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:13 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Volume 11d1f3f3-b82f-44f3-af93-bd924a8a0f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a', 'volume_size': 1} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1228896517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d1f3f3-b82f-44f3-af93-bd924a8a0f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:14Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Creating volume 11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:13 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:13 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:13 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a 1073741824 Sep 07 17:02:13 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:14 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a 1073741824" returned: 0 in 0.403s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:14 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a Sep 07 17:02:14 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:14 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" returned: 0 in 0.249s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18d095e-306e-4a72-ba39-871d332ad2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78512a26-431a-4b2a-98a1-00c9eb556c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:14 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Volume volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a (11d1f3f3-b82f-44f3-af93-bd924a8a0f6a): created successfully Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78512a26-431a-4b2a-98a1-00c9eb556c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (81095cfc-2c4f-4f68-aec2-f696755815b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Acquiring lock "cinder-75b883c2-a176-4e07-acc7-45040503f929-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:14 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-00966b53-14b5-4591-9419-ca765cc4b680 tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Lock "cinder-75b883c2-a176-4e07-acc7-45040503f929-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Acquiring lock "cinder-quobyte-75b883c2-a176-4e07-acc7-45040503f929" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Lock "cinder-quobyte-75b883c2-a176-4e07-acc7-45040503f929" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ee1430-6447-4f80-8580-b784b484b12d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:14 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 Sep 07 17:02:14 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Creating offline snapshot cbf1a579-4a93-4edc-b31e-ea55fa68a40d of volume 11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[2420c3d0-abb5-4e3b-ba47-1aa1eb3ecd6a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:14 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a Sep 07 17:02:14 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:14 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929" returned: 0 in 0.377s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:14 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:14 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929 Sep 07 17:02:14 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:15 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" returned: 0 in 0.346s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:15 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-75b883c2-a176-4e07-acc7-45040503f929" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Lock "cinder-quobyte-75b883c2-a176-4e07-acc7-45040503f929" released by "delete_volume" :: held 0.660s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:15 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d 1G Sep 07 17:02:15 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Created reservations ['f6bec094-e33a-4a21-b659-f3526dcb14c2', 'd56bcd29-e205-4ef1-b49e-b473f7957a54', 'ce716d35-075e-4640-a915-a06061916a71', '9917ebe4-0066-45f2-a40c-d665af42a761'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:15 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:15 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:15 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:15 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d 1G" returned: 0 in 0.407s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:15 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Deleted volume successfully. Sep 07 17:02:15 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d Sep 07 17:02:15 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ac6e034f-a875-4ec5-9013-bf4ae84485b3 tempest-ProjectReaderTests-513735808 None] Lock "cinder-75b883c2-a176-4e07-acc7-45040503f929-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:15 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d" returned: 0 in 0.321s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:15 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d is being set with open permissions: ugo+rw Sep 07 17:02:15 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:15 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d Sep 07 17:02:15 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Flow 'volume_create_manager' (a38ffb34-2424-437b-b46c-f15f95b665e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9e7bd0-c3c5-4790-834a-1f44d46c026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9e7bd0-c3c5-4790-834a-1f44d46c026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534629549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d86894a-99ec-4f57-a355-dae46d865d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57aac0b9bd440bb9b722288987778f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:16Z,use_quota=True,user_id='b3f0c4cd083c45d99d96cb84c997b221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5540214-4102-401c-9541-35bcc66b622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5540214-4102-401c-9541-35bcc66b622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfe52f9-caaa-45cd-8334-964d05878495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:16 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfe52f9-caaa-45cd-8334-964d05878495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d86894a-99ec-4f57-a355-dae46d865d4b', 'volume_name': 'volume-4d86894a-99ec-4f57-a355-dae46d865d4b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e1a0ec-680e-4e69-8e29-51aeb4d3bb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e1a0ec-680e-4e69-8e29-51aeb4d3bb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891845f6-af2c-4ffd-846c-30a6a1b6f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:16 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Volume 4d86894a-99ec-4f57-a355-dae46d865d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d86894a-99ec-4f57-a355-dae46d865d4b', 'volume_size': 1} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:16 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.info Sep 07 17:02:16 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:16 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.info" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:16 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.info is being set with open permissions: ugo+rw Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:16 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.info Sep 07 17:02:16 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:16 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.info" returned: 0 in 0.241s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1534629549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d86894a-99ec-4f57-a355-dae46d865d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e57aac0b9bd440bb9b722288987778f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:16Z,use_quota=True,user_id='b3f0c4cd083c45d99d96cb84c997b221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Creating volume 4d86894a-99ec-4f57-a355-dae46d865d4b {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:16 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:16 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b 1073741824 Sep 07 17:02:16 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:16 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8e4d9caf-79ff-4339-b922-7da996dfadd7 tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-cbf1a579-4a93-4edc-b31e-ea55fa68a40d-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Lock "cinder-cbf1a579-4a93-4edc-b31e-ea55fa68a40d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-cbf1a579-4a93-4edc-b31e-ea55fa68a40d" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:16 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-cbf1a579-4a93-4edc-b31e-ea55fa68a40d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot cbf1a579-4a93-4edc-b31e-ea55fa68a40d of volume 11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d10ac-84b4-4834-956c-51bf378942d4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:17 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d Sep 07 17:02:17 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:17 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b 1073741824" returned: 0 in 0.470s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:17 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b Sep 07 17:02:17 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:17 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d" returned: 0 in 0.360s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[84670f71-f558-47a2-aaf7-dd64371917e4]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:17 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b" returned: 0 in 0.253s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891845f6-af2c-4ffd-846c-30a6a1b6f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d86894a-99ec-4f57-a355-dae46d865d4b', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2c5dc1-ef27-4284-8c58-87d8a5ecce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:17 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Volume volume-4d86894a-99ec-4f57-a355-dae46d865d4b (4d86894a-99ec-4f57-a355-dae46d865d4b): created successfully Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2c5dc1-ef27-4284-8c58-87d8a5ecce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Flow 'volume_create_manager' (a38ffb34-2424-437b-b46c-f15f95b665e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:17 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9e0d21c7-7c2b-4a2f-af61-51922bf67a99 tempest-ProjectReaderTests-513735808 None] Created volume successfully. Sep 07 17:02:17 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a Sep 07 17:02:17 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:17 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" returned: 0 in 0.375s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:17 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d Sep 07 17:02:17 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:18 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d" returned: 0 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:18 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d Sep 07 17:02:18 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Acquiring lock "cinder-4d86894a-99ec-4f57-a355-dae46d865d4b-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Lock "cinder-4d86894a-99ec-4f57-a355-dae46d865d4b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Acquiring lock "cinder-quobyte-4d86894a-99ec-4f57-a355-dae46d865d4b" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Lock "cinder-quobyte-4d86894a-99ec-4f57-a355-dae46d865d4b" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[468845c1-e5b1-44b0-9ea3-acd1bc0d49f0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:18 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:18 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a.cbf1a579-4a93-4edc-b31e-ea55fa68a40d" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:18 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-cbf1a579-4a93-4edc-b31e-ea55fa68a40d" released by "_delete_snapshot" :: held 1.432s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" released by "delete_snapshot" :: held 1.457s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Created reservations ['3f511e90-fbd5-40f2-a212-48d66b5c0468', '418704ee-8ae4-482a-be98-be6132ed5be8', '71a6e06a-7952-4fa5-9f21-d3bfd68e6712', '8d94d611-f19d-4eac-86fe-839f6466e522'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:18 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-9d874aa1-e769-4a07-8a1b-e1124ab9db26 tempest-ProjectMemberTests-775595433 None] Lock "cinder-cbf1a579-4a93-4edc-b31e-ea55fa68a40d-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:18 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b" returned: 0 in 0.365s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:18 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b Sep 07 17:02:18 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:18 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4d86894a-99ec-4f57-a355-dae46d865d4b" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Lock "cinder-quobyte-4d86894a-99ec-4f57-a355-dae46d865d4b" released by "delete_volume" :: held 0.657s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:18 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Created reservations ['46455652-46a7-4a2c-b80b-b9324088bcc9', 'bcaeba2d-ae54-43f6-9f7f-e5fc83706228', '702b09b4-9052-4735-bf2e-4c2b03e0a1af', '2bce44c7-874d-4da3-8ffa-70852f0c7aaf'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:19 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:19 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Lock "cinder-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" acquired by "delete_volume" :: waited 0.026s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566a6b2-319d-4386-9e3c-097a302fc92c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:19 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a Sep 07 17:02:19 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:19 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.312s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:19 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Deleted volume successfully. Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-66628db2-20f3-43f9-8e93-7dfe47246848 tempest-ProjectReaderTests-513735808 None] Lock "cinder-4d86894a-99ec-4f57-a355-dae46d865d4b-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:19 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" returned: 0 in 0.413s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:19 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a Sep 07 17:02:19 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:19 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" returned: 0 in 0.266s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a" released by "delete_volume" :: held 0.747s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:19 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Created reservations ['17841705-7008-41de-a631-753a521df1cc', 'a15d2817-400d-43f3-af5f-a0a3478f946d', '401d0508-166c-45cb-bdd9-471e700cc29e', '6c664f93-b47f-466a-bc81-4c022c7fba8a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:20 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:20 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:20 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.278s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:20 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-4c61ef0e-b2d5-4545-bbf5-d9123053e1ea tempest-ProjectMemberTests-775595433 None] Lock "cinder-11d1f3f3-b82f-44f3-af93-bd924a8a0f6a-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (685b9bd0-91d6-4b72-9c27-919650f8a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c5fc5d-4a62-445d-853a-7d8e3f500f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c5fc5d-4a62-445d-853a-7d8e3f500f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163745771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904af85b-d73a-41e8-8f6c-528862655f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:21Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a840308-b3ee-4477-aaa2-e2b750a4f25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a840308-b3ee-4477-aaa2-e2b750a4f25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc38664c-01ac-4f89-9509-ce9663551c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc38664c-01ac-4f89-9509-ce9663551c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904af85b-d73a-41e8-8f6c-528862655f55', 'volume_name': 'volume-904af85b-d73a-41e8-8f6c-528862655f55', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf7dc7b-47f9-4e8a-b7a8-afd887a151ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf7dc7b-47f9-4e8a-b7a8-afd887a151ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb46725-c4b6-40ba-9cec-0d5e3a5a5306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:20 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Volume 904af85b-d73a-41e8-8f6c-528862655f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904af85b-d73a-41e8-8f6c-528862655f55', 'volume_size': 1} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163745771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904af85b-d73a-41e8-8f6c-528862655f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:21Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Creating volume 904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:20 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:20 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:20 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 1073741824 Sep 07 17:02:20 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:21 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 1073741824" returned: 0 in 0.448s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:21 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 Sep 07 17:02:21 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:21 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb46725-c4b6-40ba-9cec-0d5e3a5a5306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904af85b-d73a-41e8-8f6c-528862655f55', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed636c8-bb12-4681-81da-1163172de2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:21 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Volume volume-904af85b-d73a-41e8-8f6c-528862655f55 (904af85b-d73a-41e8-8f6c-528862655f55): created successfully Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed636c8-bb12-4681-81da-1163172de2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:21 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (685b9bd0-91d6-4b72-9c27-919650f8a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:21 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-86199e10-8457-4a8b-8703-8833fc832942 tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 5089a813-776f-45f2-9494-2afb2d5a5b97 of volume 904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b63844a-a280-4f52-aa88-7fa1f17be8af]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:23 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 Sep 07 17:02:23 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (39a3eda8-7c5d-4d30-aecc-4d0afa9af6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7c3659-3b90-4589-8b3b-a608dcf4e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7c3659-3b90-4589-8b3b-a608dcf4e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346000195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd30cda2-e6c8-4a24-a8df-53cea2fde05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:23Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c83d6f1-ac85-4cc5-9f76-250033a650b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c83d6f1-ac85-4cc5-9f76-250033a650b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba6e3d9-b674-437a-b5e0-a5e3ef809d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba6e3d9-b674-437a-b5e0-a5e3ef809d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd30cda2-e6c8-4a24-a8df-53cea2fde05e', 'volume_name': 'volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc36c2e1-bc95-40f0-9b5b-dce15106de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc36c2e1-bc95-40f0-9b5b-dce15106de92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b5c181-362c-492c-aedf-e185a0a6679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:23 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Volume cd30cda2-e6c8-4a24-a8df-53cea2fde05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e', 'volume_size': 1} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:23 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55" returned: 0 in 0.376s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:23 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 1G Sep 07 17:02:23 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:23 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 1G" returned: 0 in 0.394s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:23 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904af85b-d73a-41e8-8f6c-528862655f55 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:23 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904af85b-d73a-41e8-8f6c-528862655f55 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 Sep 07 17:02:23 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:24 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904af85b-d73a-41e8-8f6c-528862655f55 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97" returned: 0 in 0.305s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:24 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 is being set with open permissions: ugo+rw Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:24 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 Sep 07 17:02:24 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:24 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97" returned: 0 in 0.241s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:24 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.info Sep 07 17:02:24 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:24 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.info" returned: 0 in 0.252s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:24 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.info is being set with open permissions: ugo+rw Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:24 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.info Sep 07 17:02:24 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:24 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.info" returned: 0 in 0.235s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346000195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd30cda2-e6c8-4a24-a8df-53cea2fde05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:23Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Creating volume cd30cda2-e6c8-4a24-a8df-53cea2fde05e {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:24 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:24 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:25 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e 1073741824 Sep 07 17:02:25 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e4d03166-864f-4fb1-a188-2f09b3e976b5 tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-5089a813-776f-45f2-9494-2afb2d5a5b97-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Lock "cinder-5089a813-776f-45f2-9494-2afb2d5a5b97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-904af85b-d73a-41e8-8f6c-528862655f55" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-904af85b-d73a-41e8-8f6c-528862655f55" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-5089a813-776f-45f2-9494-2afb2d5a5b97" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-5089a813-776f-45f2-9494-2afb2d5a5b97" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 5089a813-776f-45f2-9494-2afb2d5a5b97 of volume 904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee45d7-41b6-4014-b8f2-1e2acf89b9ea]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:25 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 Sep 07 17:02:25 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:25 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e 1073741824" returned: 0 in 0.458s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:25 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e Sep 07 17:02:25 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:25 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97" returned: 0 in 0.373s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-904af85b-d73a-41e8-8f6c-528862655f55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a7b573-2b33-4910-b052-53acfc4ef3ee]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:25 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e" returned: 0 in 0.262s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b5c181-362c-492c-aedf-e185a0a6679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3b1acd-1a95-4f82-a355-8bdf95fd9141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:25 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Volume volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e (cd30cda2-e6c8-4a24-a8df-53cea2fde05e): created successfully Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3b1acd-1a95-4f82-a355-8bdf95fd9141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:25 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (39a3eda8-7c5d-4d30-aecc-4d0afa9af6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:25 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6f087f21-297d-4704-81c6-6670ddea0d0a tempest-ProjectReaderTests-378832434 None] Created volume successfully. Sep 07 17:02:25 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 Sep 07 17:02:25 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:26 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:26 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 Sep 07 17:02:26 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:26 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97" returned: 0 in 0.334s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:26 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97 Sep 07 17:02:26 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-cd30cda2-e6c8-4a24-a8df-53cea2fde05e-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Lock "cinder-cd30cda2-e6c8-4a24-a8df-53cea2fde05e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-quobyte-cd30cda2-e6c8-4a24-a8df-53cea2fde05e" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-cd30cda2-e6c8-4a24-a8df-53cea2fde05e" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:26 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55.5089a813-776f-45f2-9494-2afb2d5a5b97" returned: 0 in 0.287s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd20242-ff17-451e-9ad6-38e07637c33e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-5089a813-776f-45f2-9494-2afb2d5a5b97" released by "_delete_snapshot" :: held 1.452s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-904af85b-d73a-41e8-8f6c-528862655f55" released by "delete_snapshot" :: held 1.476s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Created reservations ['fed0e918-fb48-4306-8417-d011056f4ffe', 'e1402386-c355-4caa-bec7-4a45cdd0ab88', '40297baf-13fc-458a-9aa9-37b1db942c33', '08bc3c5d-bfa5-4eb7-aca4-8d840c5e3242'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:26 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e Sep 07 17:02:26 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:26 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:26 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-093e02f9-e69e-4e6d-8f53-bf43f1839eec tempest-ProjectMemberTests-775595433 None] Lock "cinder-5089a813-776f-45f2-9494-2afb2d5a5b97-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:27 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e" returned: 0 in 0.360s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:27 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e Sep 07 17:02:27 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:27 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-cd30cda2-e6c8-4a24-a8df-53cea2fde05e" returned: 0 in 0.246s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-cd30cda2-e6c8-4a24-a8df-53cea2fde05e" released by "delete_volume" :: held 0.668s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Created reservations ['02b4bef9-8af3-43b7-b29f-dfd961e8e5b3', '915658d2-c644-4aba-864b-69db8641921d', '4124de92-e1f8-48d3-a2ff-647baa0d1ad8', '835d85fa-e870-4a6d-a45e-338a28a8d595'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-904af85b-d73a-41e8-8f6c-528862655f55-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Lock "cinder-904af85b-d73a-41e8-8f6c-528862655f55-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-904af85b-d73a-41e8-8f6c-528862655f55" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-904af85b-d73a-41e8-8f6c-528862655f55" acquired by "delete_volume" :: waited 0.034s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:27 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:27 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc98b6-3743-471d-af54-8028e353ce7e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:27 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 Sep 07 17:02:27 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:27 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.257s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:27 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Deleted volume successfully. Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-b09de4b7-14b6-4b38-8491-0282915b8d7b tempest-ProjectReaderTests-378832434 None] Lock "cinder-cd30cda2-e6c8-4a24-a8df-53cea2fde05e-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:27 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55" returned: 0 in 0.397s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:27 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:27 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55 Sep 07 17:02:27 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:28 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-904af85b-d73a-41e8-8f6c-528862655f55" returned: 0 in 0.260s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-904af85b-d73a-41e8-8f6c-528862655f55" released by "delete_volume" :: held 0.720s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (6fd3b0d4-ceb3-49da-9b44-cd4a9d054b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106af210-1b2f-4208-91b6-d09a6beb64af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106af210-1b2f-4208-91b6-d09a6beb64af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616775459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcb627b-9d1d-4667-adcc-5b73df240fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:28Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c4d8a1-647e-49b8-946e-4085d72e6e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c4d8a1-647e-49b8-946e-4085d72e6e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e4d81f-4c94-40c6-a009-24577902bcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e4d81f-4c94-40c6-a009-24577902bcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcb627b-9d1d-4667-adcc-5b73df240fca', 'volume_name': 'volume-dbcb627b-9d1d-4667-adcc-5b73df240fca', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74be249a-8578-4e23-a0e2-ad3b7a2c737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74be249a-8578-4e23-a0e2-ad3b7a2c737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfebe821-73c7-4f32-b401-cfacae02b70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:28 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Volume dbcb627b-9d1d-4667-adcc-5b73df240fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcb627b-9d1d-4667-adcc-5b73df240fca', 'volume_size': 1} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616775459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcb627b-9d1d-4667-adcc-5b73df240fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:28Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Creating volume dbcb627b-9d1d-4667-adcc-5b73df240fca {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:28 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:28 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca 1073741824 Sep 07 17:02:28 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Created reservations ['22c611a6-595e-41d4-a2e2-9989f02385e2', 'c7b93248-e663-4399-8550-fca7bfec2686', '7ac38fb3-e3d1-432f-b122-aee51eff74f1', 'a9029f60-b31d-43f1-af23-8bcd99373f65'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:28 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:28 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:28 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.295s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:28 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e640c272-f2e5-4f02-a366-83e732937a1b tempest-ProjectMemberTests-775595433 None] Lock "cinder-904af85b-d73a-41e8-8f6c-528862655f55-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:28 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca 1073741824" returned: 0 in 0.485s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:28 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:28 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca Sep 07 17:02:28 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:29 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (46751727-2cc0-46f2-b46a-b016f5f30e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6efd83a-77e8-4622-a3fe-37b662265c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca" returned: 0 in 0.276s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6efd83a-77e8-4622-a3fe-37b662265c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-706670874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f9387a-cef7-49cf-a8cb-6d716b6490fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:29Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4547176a-b33d-448f-ab35-1e90c150cadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4547176a-b33d-448f-ab35-1e90c150cadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a60999-3106-4491-a38c-d3b4d95c078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2a60999-3106-4491-a38c-d3b4d95c078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f9387a-cef7-49cf-a8cb-6d716b6490fa', 'volume_name': 'volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cf100b-cbdb-42b1-a4c2-a9ce4cd9feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cf100b-cbdb-42b1-a4c2-a9ce4cd9feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c62b1d-3a56-46c4-a085-e8ac24792949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Volume e1f9387a-cef7-49cf-a8cb-6d716b6490fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa', 'volume_size': 1} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-706670874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f9387a-cef7-49cf-a8cb-6d716b6490fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:29Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Creating volume e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:29 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfebe821-73c7-4f32-b401-cfacae02b70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcb627b-9d1d-4667-adcc-5b73df240fca', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6bfcfd-84f7-49fb-970c-8fa2693a7993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa 1073741824 Sep 07 17:02:29 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Volume volume-dbcb627b-9d1d-4667-adcc-5b73df240fca (dbcb627b-9d1d-4667-adcc-5b73df240fca): created successfully Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6bfcfd-84f7-49fb-970c-8fa2693a7993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (6fd3b0d4-ceb3-49da-9b44-cd4a9d054b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-b5a70f1e-055f-476f-8c3b-da47418224c0 tempest-ProjectReaderTests-378832434 None] Created volume successfully. Sep 07 17:02:29 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa 1073741824" returned: 0 in 0.431s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:29 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa Sep 07 17:02:29 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:29 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c62b1d-3a56-46c4-a085-e8ac24792949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3850f1-f238-4530-8f3c-038723f200c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Volume volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa (e1f9387a-cef7-49cf-a8cb-6d716b6490fa): created successfully Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3850f1-f238-4530-8f3c-038723f200c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (46751727-2cc0-46f2-b46a-b016f5f30e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:29 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-fb77a4ce-e887-4c7c-9540-551eff74bf2f tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 88fdba0b-9c34-4a2b-a327-7cafc820b734 of volume e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f2d4eb-61da-435c-a010-6c2e800094c9]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-dbcb627b-9d1d-4667-adcc-5b73df240fca-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Lock "cinder-dbcb627b-9d1d-4667-adcc-5b73df240fca-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-quobyte-dbcb627b-9d1d-4667-adcc-5b73df240fca" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-dbcb627b-9d1d-4667-adcc-5b73df240fca" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:30 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa Sep 07 17:02:30 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bfe25c-9bce-4413-8fdf-dee1f9662733]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:30 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca Sep 07 17:02:30 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:30 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" returned: 0 in 0.428s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:30 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 1G Sep 07 17:02:30 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:30 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca" returned: 0 in 0.396s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:30 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:30 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca Sep 07 17:02:30 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:31 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-dbcb627b-9d1d-4667-adcc-5b73df240fca" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-dbcb627b-9d1d-4667-adcc-5b73df240fca" released by "delete_volume" :: held 0.694s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Created reservations ['a41af6ae-604f-4e8f-8800-2ab043091543', '528065b9-7bf2-40fd-a23b-4a6ed8c077bb', '52f29447-9e25-4719-b619-96e3e19b52d4', 'd802b176-c545-4e98-b669-30a0c5569e13'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:31 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 1G" returned: 0 in 0.475s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:31 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 Sep 07 17:02:31 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:31 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:31 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:31 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734" returned: 0 in 0.331s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:31 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 is being set with open permissions: ugo+rw Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:31 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.269s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:31 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Deleted volume successfully. Sep 07 17:02:31 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 Sep 07 17:02:31 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-92e28a25-adf0-4b01-9258-87336137512c tempest-ProjectReaderTests-378832434 None] Lock "cinder-dbcb627b-9d1d-4667-adcc-5b73df240fca-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:31 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:31 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:31 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.info Sep 07 17:02:31 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (05165a8f-66df-4b39-9461-975140871c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cd7aec-cb4e-4f35-8cd6-ce0e6c5c146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cd7aec-cb4e-4f35-8cd6-ce0e6c5c146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2125567491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edc2127-a6dc-4d0b-8588-d787ff27f659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:32Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e16762-5b14-48a7-a871-02e4f53faba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e16762-5b14-48a7-a871-02e4f53faba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0867531f-5247-4f77-ac74-1f82886398ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0867531f-5247-4f77-ac74-1f82886398ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edc2127-a6dc-4d0b-8588-d787ff27f659', 'volume_name': 'volume-9edc2127-a6dc-4d0b-8588-d787ff27f659', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e51006-ab40-4f6f-b5d7-51fcdb8e8755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e51006-ab40-4f6f-b5d7-51fcdb8e8755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57db8fa-0a40-4451-b64e-d1d080609870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:32 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Volume 9edc2127-a6dc-4d0b-8588-d787ff27f659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edc2127-a6dc-4d0b-8588-d787ff27f659', 'volume_size': 1} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:32 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.info" returned: 0 in 0.253s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:32 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.info is being set with open permissions: ugo+rw Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:32 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.info Sep 07 17:02:32 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:32 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.info" returned: 0 in 0.250s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2125567491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edc2127-a6dc-4d0b-8588-d787ff27f659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:32Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Creating volume 9edc2127-a6dc-4d0b-8588-d787ff27f659 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:32 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:32 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 1073741824 Sep 07 17:02:32 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:32 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-18b63960-9613-4478-b4d6-cdf32073ba1c tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:02:32 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 1073741824" returned: 0 in 0.433s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:32 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:32 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 Sep 07 17:02:32 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:33 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659" returned: 0 in 0.233s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57db8fa-0a40-4451-b64e-d1d080609870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edc2127-a6dc-4d0b-8588-d787ff27f659', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bfb55c-0a78-4ffc-aa8d-c67911a8cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:33 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Volume volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 (9edc2127-a6dc-4d0b-8588-d787ff27f659): created successfully Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bfb55c-0a78-4ffc-aa8d-c67911a8cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (05165a8f-66df-4b39-9461-975140871c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:33 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2300dd78-970c-4a75-820b-50d71e079231 tempest-ProjectReaderTests-378832434 None] Created volume successfully. Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-88fdba0b-9c34-4a2b-a327-7cafc820b734-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:33 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:33 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Lock "cinder-88fdba0b-9c34-4a2b-a327-7cafc820b734-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-88fdba0b-9c34-4a2b-a327-7cafc820b734" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-88fdba0b-9c34-4a2b-a327-7cafc820b734" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 88fdba0b-9c34-4a2b-a327-7cafc820b734 of volume e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9abbefd-330f-464c-99b1-4691d5c84aff]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:33 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 Sep 07 17:02:33 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:33 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.271s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:02:33 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734" returned: 0 in 0.374s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[31474846-a834-4099-928b-5637163cf95a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:34 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa Sep 07 17:02:34 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-9edc2127-a6dc-4d0b-8588-d787ff27f659-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Lock "cinder-9edc2127-a6dc-4d0b-8588-d787ff27f659-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-quobyte-9edc2127-a6dc-4d0b-8588-d787ff27f659" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-9edc2127-a6dc-4d0b-8588-d787ff27f659" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0597a-b3bb-4c13-b7d9-81db80d3a558]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:34 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" returned: 0 in 0.362s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:34 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 Sep 07 17:02:34 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:34 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 Sep 07 17:02:34 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:34 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659" returned: 0 in 0.368s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:34 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659 Sep 07 17:02:34 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:34 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734" returned: 0 in 0.353s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:34 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734 Sep 07 17:02:34 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:34 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-9edc2127-a6dc-4d0b-8588-d787ff27f659" returned: 0 in 0.266s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-9edc2127-a6dc-4d0b-8588-d787ff27f659" released by "delete_volume" :: held 0.676s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:34 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa.88fdba0b-9c34-4a2b-a327-7cafc820b734" returned: 0 in 0.276s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:34 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-88fdba0b-9c34-4a2b-a327-7cafc820b734" released by "_delete_snapshot" :: held 1.463s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" released by "delete_snapshot" :: held 1.488s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Created reservations ['105c8304-8313-494a-8842-e0429fc0eb2e', '40658b05-bb93-4334-a28a-333a1e9d79a8', 'b3563280-09fc-4f36-866b-325028217160', 'c6e5b49b-8ccc-4f14-8304-6dd4e637eaea'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Created reservations ['be1d2941-507c-4ca6-a0a5-9a67e586e78d', '4946995c-2cb1-433b-9e44-53b55efc21cb', '341ba1c8-73b0-42f0-a72a-f0e8f799f56a', '6de1a978-6045-448f-b1b1-815abdf961cd'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:35 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:35 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:35 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f74efb53-9dee-46ff-8a38-fc7b08d0101e tempest-ProjectMemberTests-775595433 None] Lock "cinder-88fdba0b-9c34-4a2b-a327-7cafc820b734-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:35 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:35 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Deleted volume successfully. Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-da70a5c2-9c3e-408b-95fd-146e3d4ed0dc tempest-ProjectReaderTests-378832434 None] Lock "cinder-9edc2127-a6dc-4d0b-8588-d787ff27f659-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-e1f9387a-cef7-49cf-a8cb-6d716b6490fa-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Lock "cinder-e1f9387a-cef7-49cf-a8cb-6d716b6490fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" acquired by "delete_volume" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[374f803d-04fe-437f-b274-ef479e338ce2]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:35 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa Sep 07 17:02:35 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (dcd544f0-66ea-4fa0-be4a-fc21a9f0db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2292d0-2cae-4848-abee-9b4f0e1bbb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2292d0-2cae-4848-abee-9b4f0e1bbb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52908436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b65112a-1b9c-4367-b469-436905b7a400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:36Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016c0398-12a8-4956-b69f-db6602388ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016c0398-12a8-4956-b69f-db6602388ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb2cb95-8107-4987-82b9-5037ea2ac115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb2cb95-8107-4987-82b9-5037ea2ac115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b65112a-1b9c-4367-b469-436905b7a400', 'volume_name': 'volume-4b65112a-1b9c-4367-b469-436905b7a400', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff261a2-7be4-4524-9764-85e1dcafcb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff261a2-7be4-4524-9764-85e1dcafcb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d78e13-c9bc-41d0-bb1e-d9f5025d97b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:35 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Volume 4b65112a-1b9c-4367-b469-436905b7a400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b65112a-1b9c-4367-b469-436905b7a400', 'volume_size': 1} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52908436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b65112a-1b9c-4367-b469-436905b7a400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d779ea3dfd5d4b7bb616f38f460f37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:36Z,use_quota=True,user_id='fbe15ae66291432c9264918886c32889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Creating volume 4b65112a-1b9c-4367-b469-436905b7a400 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:35 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:36 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 1073741824 Sep 07 17:02:36 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:36 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" returned: 0 in 0.375s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:36 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa Sep 07 17:02:36 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:36 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 1073741824" returned: 0 in 0.437s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:36 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-e1f9387a-cef7-49cf-a8cb-6d716b6490fa" released by "delete_volume" :: held 0.701s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:36 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 Sep 07 17:02:36 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Created reservations ['ad44ffc7-1bc1-4c5e-a1fb-f990031eb495', '41c93590-e98e-488e-8341-1712de037a7a', '9e6eee82-be4e-4652-9cea-7ea9bfcb0c93', '81c1838c-c17e-4bb5-ba75-79716282f22c'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:36 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:36 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:36 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400" returned: 0 in 0.281s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d78e13-c9bc-41d0-bb1e-d9f5025d97b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b65112a-1b9c-4367-b469-436905b7a400', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48be2a7-cfc4-4e95-a930-b1eebdcfd43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:36 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Volume volume-4b65112a-1b9c-4367-b469-436905b7a400 (4b65112a-1b9c-4367-b469-436905b7a400): created successfully Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48be2a7-cfc4-4e95-a930-b1eebdcfd43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Flow 'volume_create_manager' (dcd544f0-66ea-4fa0-be4a-fc21a9f0db4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-cb064b33-0809-47ad-aaa1-98cbcf2eb01b tempest-ProjectReaderTests-378832434 None] Created volume successfully. Sep 07 17:02:36 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.271s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:36 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:36 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-2987937f-1856-4cc6-aceb-57bd32dde482 tempest-ProjectMemberTests-775595433 None] Lock "cinder-e1f9387a-cef7-49cf-a8cb-6d716b6490fa-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (d18cf5c9-24c0-4814-96cf-e838ecf39694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6437ec3e-0167-4f88-8f82-8965c439c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6437ec3e-0167-4f88-8f82-8965c439c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1040912289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216b8837-19a0-4362-8403-bee19156a835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:37Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b046a2f-4930-4861-9eb5-db119222e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b046a2f-4930-4861-9eb5-db119222e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df34419-fb05-4ea0-949e-1f5d245f0739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df34419-fb05-4ea0-949e-1f5d245f0739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216b8837-19a0-4362-8403-bee19156a835', 'volume_name': 'volume-216b8837-19a0-4362-8403-bee19156a835', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b87daa-6d1b-4fb0-8cd4-3756e78725bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b87daa-6d1b-4fb0-8cd4-3756e78725bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d20b8be-cea6-49d0-b52f-4eebfda211a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:37 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Volume 216b8837-19a0-4362-8403-bee19156a835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216b8837-19a0-4362-8403-bee19156a835', 'volume_size': 1} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1040912289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216b8837-19a0-4362-8403-bee19156a835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:37Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Creating volume 216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:37 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:37 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 1073741824 Sep 07 17:02:37 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:37 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 1073741824" returned: 0 in 0.417s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:37 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 Sep 07 17:02:37 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-4b65112a-1b9c-4367-b469-436905b7a400-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Lock "cinder-4b65112a-1b9c-4367-b469-436905b7a400-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Acquiring lock "cinder-quobyte-4b65112a-1b9c-4367-b469-436905b7a400" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:38 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-4b65112a-1b9c-4367-b469-436905b7a400" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835" returned: 0 in 0.275s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d20b8be-cea6-49d0-b52f-4eebfda211a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216b8837-19a0-4362-8403-bee19156a835', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d28496-db00-4c2f-8e33-fd56362a6850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b5aad0-d1e0-42d0-99f1-2d40a31cf1d0]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Volume volume-216b8837-19a0-4362-8403-bee19156a835 (216b8837-19a0-4362-8403-bee19156a835): created successfully Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d28496-db00-4c2f-8e33-fd56362a6850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (d18cf5c9-24c0-4814-96cf-e838ecf39694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:38 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-40c73b6d-796a-43ea-95df-60be59244edb tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:02:38 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 Sep 07 17:02:38 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:38 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 75e43d4d-8172-4d34-8d21-00098a1828a2 of volume 216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400" returned: 0 in 0.411s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cbd14e-9939-490e-b1bd-aa8e022bd327]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400 Sep 07 17:02:38 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:38 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 Sep 07 17:02:38 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:38 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4b65112a-1b9c-4367-b469-436905b7a400" returned: 0 in 0.287s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Lock "cinder-quobyte-4b65112a-1b9c-4367-b469-436905b7a400" released by "delete_volume" :: held 0.757s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Created reservations ['200ad16b-f8a4-4b0a-9ca3-a722020a2a12', '30200469-95ff-465e-8f91-10f26d4614ca', '38e8d703-7fe6-46ef-abbe-5e2dee9acfca', '88508e46-f9dd-44ff-b9bd-40aeb6192c2d'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835" returned: 0 in 0.420s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:38 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:39 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 1G Sep 07 17:02:39 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:39 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.264s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:39 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:39 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Deleted volume successfully. Sep 07 17:02:39 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-387d4b35-9023-46e7-ae7c-50e0c6c5bb66 tempest-ProjectReaderTests-378832434 None] Lock "cinder-4b65112a-1b9c-4367-b469-436905b7a400-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:39 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 1G" returned: 0 in 0.443s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216b8837-19a0-4362-8403-bee19156a835 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:39 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216b8837-19a0-4362-8403-bee19156a835 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 Sep 07 17:02:39 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:39 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-216b8837-19a0-4362-8403-bee19156a835 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2" returned: 0 in 0.325s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:39 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 is being set with open permissions: ugo+rw Sep 07 17:02:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:39 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 Sep 07 17:02:39 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:40 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2" returned: 0 in 0.262s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:40 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.info Sep 07 17:02:40 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:40 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.info" returned: 0 in 0.291s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:40 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.info is being set with open permissions: ugo+rw Sep 07 17:02:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:40 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.info Sep 07 17:02:40 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:40 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.info" returned: 0 in 0.262s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:40 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:40 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ca96f8e3-7025-410d-833f-e5bef6d9657f tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-75e43d4d-8172-4d34-8d21-00098a1828a2-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Lock "cinder-75e43d4d-8172-4d34-8d21-00098a1828a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-216b8837-19a0-4362-8403-bee19156a835" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-216b8837-19a0-4362-8403-bee19156a835" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-75e43d4d-8172-4d34-8d21-00098a1828a2" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-75e43d4d-8172-4d34-8d21-00098a1828a2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 75e43d4d-8172-4d34-8d21-00098a1828a2 of volume 216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b04556-9973-4030-b009-c4744cadc928]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:41 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:41 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 Sep 07 17:02:41 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:42 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2" returned: 0 in 0.343s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-216b8837-19a0-4362-8403-bee19156a835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f61c3-bae1-44d8-9d85-50768ebb1337]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:42 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 Sep 07 17:02:42 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:42 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835" returned: 0 in 0.342s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:42 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 Sep 07 17:02:42 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:42 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2" returned: 0 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:42 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:42 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2 Sep 07 17:02:42 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:43 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835.75e43d4d-8172-4d34-8d21-00098a1828a2" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-75e43d4d-8172-4d34-8d21-00098a1828a2" released by "_delete_snapshot" :: held 1.347s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-216b8837-19a0-4362-8403-bee19156a835" released by "delete_snapshot" :: held 1.369s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Created reservations ['051e6614-97a5-41a9-bccd-deed7dc1d0bc', 'fa2e69e6-95e1-4863-bf94-195482c6cdbd', '788853c1-d58f-4f84-86da-7c1381f73e1c', '216f55d2-1cc3-476f-9abb-d532bcede366'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-e884840c-ced1-4af0-b9cb-6c97df394825 tempest-ProjectMemberTests-775595433 None] Lock "cinder-75e43d4d-8172-4d34-8d21-00098a1828a2-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-216b8837-19a0-4362-8403-bee19156a835-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Lock "cinder-216b8837-19a0-4362-8403-bee19156a835-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-216b8837-19a0-4362-8403-bee19156a835" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-216b8837-19a0-4362-8403-bee19156a835" acquired by "delete_volume" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0d9eb-76a7-435d-ac60-37c42b52db48]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:44 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 Sep 07 17:02:44 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:44 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835" returned: 0 in 0.336s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:44 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835 Sep 07 17:02:44 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:44 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-216b8837-19a0-4362-8403-bee19156a835" returned: 0 in 0.259s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-216b8837-19a0-4362-8403-bee19156a835" released by "delete_volume" :: held 0.647s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Created reservations ['93054509-4de4-449a-b5c9-b0111893bd08', '44913bcf-c37f-441d-8f99-d0a148a6e66c', '3464a04d-ed61-41fd-b2e8-143e70e54172', '516f0307-db23-4665-8a8b-71787148eba1'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:44 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:44 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:44 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.246s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:44 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:44 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-a3416beb-d337-42dc-864d-4b381e1283ad tempest-ProjectMemberTests-775595433 None] Lock "cinder-216b8837-19a0-4362-8403-bee19156a835-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (e01e8d27-5573-475e-ab49-0c118fe3da33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7394ef-caf1-4606-8db8-c804a131f5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7394ef-caf1-4606-8db8-c804a131f5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-179898322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:45Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71be043-bf26-471e-a698-c47d4ea7f283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71be043-bf26-471e-a698-c47d4ea7f283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070e1ade-2a99-4504-bd97-836c1d8f51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070e1ade-2a99-4504-bd97-836c1d8f51df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce', 'volume_name': 'volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09be0c09-6c91-444e-9aaa-bbd2356dae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09be0c09-6c91-444e-9aaa-bbd2356dae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a39a859-5470-4942-b652-75453deb4346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:45 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Volume 54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce', 'volume_size': 1} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-179898322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:45Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Creating volume 54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:45 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:45 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce 1073741824 Sep 07 17:02:45 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:45 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce 1073741824" returned: 0 in 0.425s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:45 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce Sep 07 17:02:45 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:46 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a39a859-5470-4942-b652-75453deb4346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7455c3-6b3f-408e-97d1-029b50b55260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:46 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Volume volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce (54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce): created successfully Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7455c3-6b3f-408e-97d1-029b50b55260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (e01e8d27-5573-475e-ab49-0c118fe3da33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:46 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-2ae04c28-f0e0-4371-8ebe-2791ee4080e7 tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 9c0f0a26-0689-461f-acaa-848c71c6be17 of volume 54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac5322c-549c-4d36-bcf7-f45bc5d6b507]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:46 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce Sep 07 17:02:46 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:46 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" returned: 0 in 0.361s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:46 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 1G Sep 07 17:02:46 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:47 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 1G" returned: 0 in 0.427s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:47 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 Sep 07 17:02:47 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:47 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17" returned: 0 in 0.310s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:47 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 is being set with open permissions: ugo+rw Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:47 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 Sep 07 17:02:47 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:47 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17" returned: 0 in 0.237s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=154,cinder:UPDATE=221,cinder:DELETE=27,cinder:INSERT=60 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=223,cinder:INSERT=55,cinder:SELECT=180,cinder:DELETE=11 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:02:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:47 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.info Sep 07 17:02:47 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:48 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.info" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:48 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.info is being set with open permissions: ugo+rw Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:48 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.info Sep 07 17:02:48 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:48 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.info" returned: 0 in 0.246s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-10612dac-c65b-45fe-8bac-9929528cc8ab tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-9c0f0a26-0689-461f-acaa-848c71c6be17-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Lock "cinder-9c0f0a26-0689-461f-acaa-848c71c6be17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-9c0f0a26-0689-461f-acaa-848c71c6be17" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-9c0f0a26-0689-461f-acaa-848c71c6be17" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 9c0f0a26-0689-461f-acaa-848c71c6be17 of volume 54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[355bf37a-6d8f-477d-ad2d-cfaa4b2921be]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:48 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 Sep 07 17:02:48 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:49 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17" returned: 0 in 0.357s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f47d7e-38e2-4501-aeaf-49e751d805b7]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:49 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce Sep 07 17:02:49 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:49 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" returned: 0 in 0.355s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:49 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 Sep 07 17:02:49 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:49 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17" returned: 0 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:49 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:49 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17 Sep 07 17:02:49 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:50 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce.9c0f0a26-0689-461f-acaa-848c71c6be17" returned: 0 in 0.280s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-9c0f0a26-0689-461f-acaa-848c71c6be17" released by "_delete_snapshot" :: held 1.409s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" released by "delete_snapshot" :: held 1.428s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Created reservations ['dbcc7644-60b9-47e6-86bf-2ab84f6a9f68', '30c27b64-c7d7-4ab7-b924-657fcfd7a105', '232bb4e0-3762-4184-a271-f2914bba43cb', '134c0743-17a4-4bd5-8ab2-1e48f39d8252'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:50 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ace76d9d-1596-4374-9486-5e999dca48e9 tempest-ProjectMemberTests-775595433 None] Lock "cinder-9c0f0a26-0689-461f-acaa-848c71c6be17-delete_snapshot" released by "delete_snapshot" :: held 1.575s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Lock "cinder-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4c41d9-788a-4a07-8f24-aa8005d7127a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:50 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:51 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce Sep 07 17:02:51 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:51 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" returned: 0 in 0.397s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:51 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce Sep 07 17:02:51 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:51 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" returned: 0 in 0.274s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce" released by "delete_volume" :: held 0.731s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Created reservations ['dc693263-9eef-4e92-9a92-0307f27b32c8', 'e25f58a8-6578-47dc-890f-0b808d9238f6', '2a3da203-0892-49e1-aa5b-e9d870a2918b', '7bccc46b-2d84-4b55-8b31-9a14d48ad012'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:51 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:51 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:51 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:52 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.292s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:52 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-cbaa183e-447d-426e-ba8d-5723a646da97 tempest-ProjectMemberTests-775595433 None] Lock "cinder-54fc39f1-57ed-40b9-a4fb-ebf4d4e87bce-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (1459c41e-546c-4e63-a17a-6ce686155a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61525a09-1e56-4ab8-9564-74cb6928fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61525a09-1e56-4ab8-9564-74cb6928fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35001985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585ef9db-7dcf-417c-815c-4313a6dcac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:52Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff9934f-1156-40e0-8479-277c3286bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff9934f-1156-40e0-8479-277c3286bc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0c68dd-fcfa-44e9-9188-9fda95593e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0c68dd-fcfa-44e9-9188-9fda95593e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585ef9db-7dcf-417c-815c-4313a6dcac2d', 'volume_name': 'volume-585ef9db-7dcf-417c-815c-4313a6dcac2d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ba9c9d-3aa5-4720-af32-c8303be28485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ba9c9d-3aa5-4720-af32-c8303be28485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f901b62-2445-44c2-b33b-65f7e8563501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:52 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Volume 585ef9db-7dcf-417c-815c-4313a6dcac2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585ef9db-7dcf-417c-815c-4313a6dcac2d', 'volume_size': 1} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-35001985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585ef9db-7dcf-417c-815c-4313a6dcac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:52Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Creating volume 585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:52 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:52 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:52 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d 1073741824 Sep 07 17:02:52 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:53 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d 1073741824" returned: 0 in 0.455s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:53 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d Sep 07 17:02:53 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:53 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d" returned: 0 in 0.243s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f901b62-2445-44c2-b33b-65f7e8563501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585ef9db-7dcf-417c-815c-4313a6dcac2d', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7905a3-8c68-4d93-9b50-7e35fc75d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:53 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Volume volume-585ef9db-7dcf-417c-815c-4313a6dcac2d (585ef9db-7dcf-417c-815c-4313a6dcac2d): created successfully Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7905a3-8c68-4d93-9b50-7e35fc75d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (1459c41e-546c-4e63-a17a-6ce686155a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:53 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-9896ec4a-d077-40bd-9824-6c61c291e5dd tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 of volume 585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[22817c65-3c74-41f4-b2d5-8c0e0c607639]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:53 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:53 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d Sep 07 17:02:53 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:54 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d" returned: 0 in 0.363s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:54 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 1G Sep 07 17:02:54 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:54 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 1G" returned: 0 in 0.406s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585ef9db-7dcf-417c-815c-4313a6dcac2d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:54 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585ef9db-7dcf-417c-815c-4313a6dcac2d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 Sep 07 17:02:54 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:54 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-585ef9db-7dcf-417c-815c-4313a6dcac2d -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" returned: 0 in 0.304s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:54 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 is being set with open permissions: ugo+rw Sep 07 17:02:54 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:54 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 Sep 07 17:02:54 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:55 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" returned: 0 in 0.271s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:55 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.info Sep 07 17:02:55 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:55 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.info" returned: 0 in 0.257s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:55 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.info is being set with open permissions: ugo+rw Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:55 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.info Sep 07 17:02:55 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:55 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.info" returned: 0 in 0.254s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:55 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-007bd271-6dad-4422-ac8a-3ef5b317cf0c tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Lock "cinder-3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-585ef9db-7dcf-417c-815c-4313a6dcac2d" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-585ef9db-7dcf-417c-815c-4313a6dcac2d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 of volume 585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2beb43-51b3-4401-91b2-c622c5f45f94]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:55 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:56 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 Sep 07 17:02:56 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:56 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" returned: 0 in 0.373s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:56 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-585ef9db-7dcf-417c-815c-4313a6dcac2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:56 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b1921a-96dc-4824-af51-e02be359e498]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:56 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d Sep 07 17:02:56 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:56 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d" returned: 0 in 0.403s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:56 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:56 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 Sep 07 17:02:56 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:57 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:57 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2 Sep 07 17:02:57 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:57 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:57 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d.3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2" released by "_delete_snapshot" :: held 1.514s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-585ef9db-7dcf-417c-815c-4313a6dcac2d" released by "delete_snapshot" :: held 1.537s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:57 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Created reservations ['e033871c-2650-461a-a85a-e6c8726c315f', '668188af-298a-4db4-920c-7deedf62ed6b', '6571c11a-86bc-40b0-83bf-6ddc9d74c9f1', '22ba02da-5884-444b-90bb-27133e5667f2'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:57 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:02:57 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-456baaab-4740-40aa-8cf9-bcf8b305ce86 tempest-ProjectMemberTests-775595433 None] Lock "cinder-3b4f14e9-4d52-42e0-939d-9ca49b5e0bb2-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-585ef9db-7dcf-417c-815c-4313a6dcac2d-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Lock "cinder-585ef9db-7dcf-417c-815c-4313a6dcac2d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-585ef9db-7dcf-417c-815c-4313a6dcac2d" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-585ef9db-7dcf-417c-815c-4313a6dcac2d" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9bab15-57cf-4f04-aa08-46753cc6956c]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:58 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d Sep 07 17:02:58 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:58 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d" returned: 0 in 0.385s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:58 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d Sep 07 17:02:58 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:58 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-585ef9db-7dcf-417c-815c-4313a6dcac2d" returned: 0 in 0.260s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-585ef9db-7dcf-417c-815c-4313a6dcac2d" released by "delete_volume" :: held 0.703s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Created reservations ['6acc3da2-81b4-4336-842d-13a25b9c67b0', 'bdb9248a-0811-4f50-bdb3-c70bb58b8798', 'a2b740a7-c236-4de6-a10b-1b315fe220b3', '60534c7c-a078-488b-a737-2036b24b1768'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:58 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:59 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:02:59 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:59 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.273s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:59 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-6f780d8f-17cb-430f-ba14-892afe0821c0 tempest-ProjectMemberTests-775595433 None] Lock "cinder-585ef9db-7dcf-417c-815c-4313a6dcac2d-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (4bb0f813-4488-42ff-b7c1-cdd8f8fe86ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b667b0-d13e-4833-b016-2f24a0512389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b667b0-d13e-4833-b016-2f24a0512389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639836352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd03eac-40de-406c-999e-111d43445db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:00Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea151bd7-7761-4d85-aa02-f6efd9eb0379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea151bd7-7761-4d85-aa02-f6efd9eb0379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81af441a-9639-45e9-afd1-c04fea8e5903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81af441a-9639-45e9-afd1-c04fea8e5903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd03eac-40de-406c-999e-111d43445db0', 'volume_name': 'volume-4dd03eac-40de-406c-999e-111d43445db0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d47b905-c8bc-4c31-9265-8f5e4451936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d47b905-c8bc-4c31-9265-8f5e4451936e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbbc7c0-416a-42c9-ab57-45e1f2dbab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:59 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Volume 4dd03eac-40de-406c-999e-111d43445db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd03eac-40de-406c-999e-111d43445db0', 'volume_size': 1} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639836352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd03eac-40de-406c-999e-111d43445db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c53722b4814ba89f351a79243f2e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:00Z,use_quota=True,user_id='59ae332572ec4ecf933de1d1b3c43bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Creating volume 4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:59 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:02:59 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:59 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 1073741824 Sep 07 17:02:59 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:00 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 1073741824" returned: 0 in 0.418s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:00 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 Sep 07 17:03:00 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:00 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0" returned: 0 in 0.265s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbbc7c0-416a-42c9-ab57-45e1f2dbab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd03eac-40de-406c-999e-111d43445db0', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016699b1-f96a-4b44-ad73-4f2d3d8de2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:00 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Volume volume-4dd03eac-40de-406c-999e-111d43445db0 (4dd03eac-40de-406c-999e-111d43445db0): created successfully Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016699b1-f96a-4b44-ad73-4f2d3d8de2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Flow 'volume_create_manager' (4bb0f813-4488-42ff-b7c1-cdd8f8fe86ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:00 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-c79e1df4-3d89-4e78-975a-e96913051876 tempest-ProjectMemberTests-775595433 None] Created volume successfully. Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Creating offline snapshot 948ec400-7e0d-4c7d-b112-7d1ade1d6f99 of volume 4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee89330-a803-4857-8293-4fda5eb5bd47]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:00 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:01 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 Sep 07 17:03:01 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:01 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0" returned: 0 in 0.375s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:01 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 1G Sep 07 17:03:01 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:01 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 1G" returned: 0 in 0.403s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd03eac-40de-406c-999e-111d43445db0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:01 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd03eac-40de-406c-999e-111d43445db0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 Sep 07 17:03:01 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:01 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd03eac-40de-406c-999e-111d43445db0 -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99" returned: 0 in 0.284s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:01 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 is being set with open permissions: ugo+rw Sep 07 17:03:01 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:02 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 Sep 07 17:03:02 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:02 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:02 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.info Sep 07 17:03:02 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:02 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.info" returned: 0 in 0.239s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:02 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.info is being set with open permissions: ugo+rw Sep 07 17:03:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:02 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.info Sep 07 17:03:02 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:02 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.info" returned: 0 in 0.244s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:02 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:02 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-35cbf57f-adee-45b5-8d6d-85e551da5d7f tempest-ProjectMemberTests-775595433 None] Create snapshot completed successfully Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-948ec400-7e0d-4c7d-b112-7d1ade1d6f99-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Lock "cinder-948ec400-7e0d-4c7d-b112-7d1ade1d6f99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-4dd03eac-40de-406c-999e-111d43445db0" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-4dd03eac-40de-406c-999e-111d43445db0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-948ec400-7e0d-4c7d-b112-7d1ade1d6f99" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-948ec400-7e0d-4c7d-b112-7d1ade1d6f99" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Deleting offline snapshot 948ec400-7e0d-4c7d-b112-7d1ade1d6f99 of volume 4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] snapshot_file for this snap is: volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94044e0-5f5d-4937-b435-abb987885a47]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:03 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 Sep 07 17:03:03 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:03 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99" returned: 0 in 0.356s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dd03eac-40de-406c-999e-111d43445db0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42e21c1-2256-4c33-ba19-25bcefd48dd5]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:03 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 Sep 07 17:03:03 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:03 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0" returned: 0 in 0.364s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:03 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:03 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 Sep 07 17:03:03 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:04 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99" returned: 0 in 0.366s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:04 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99 Sep 07 17:03:04 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:04 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:04 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0.948ec400-7e0d-4c7d-b112-7d1ade1d6f99" returned: 0 in 0.282s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-948ec400-7e0d-4c7d-b112-7d1ade1d6f99" released by "_delete_snapshot" :: held 1.470s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-4dd03eac-40de-406c-999e-111d43445db0" released by "delete_snapshot" :: held 1.493s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:04 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Created reservations ['c2f4567a-4570-4654-9ac3-db8df083e0fd', '4cf3c697-f595-4b8e-ac46-753ec43c6316', '4e59e229-4b9d-41c0-abdc-9a8d8ce5f928', 'dca24cb5-7f24-44b1-8e2c-b882cce6355f'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:04 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Delete snapshot completed successfully. Sep 07 17:03:04 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-ec268a0f-4cfd-44f8-80e9-15609cd18bb1 tempest-ProjectMemberTests-775595433 None] Lock "cinder-948ec400-7e0d-4c7d-b112-7d1ade1d6f99-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-4dd03eac-40de-406c-999e-111d43445db0-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Lock "cinder-4dd03eac-40de-406c-999e-111d43445db0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Acquiring lock "cinder-quobyte-4dd03eac-40de-406c-999e-111d43445db0" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-4dd03eac-40de-406c-999e-111d43445db0" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d728ae-b906-4960-bee5-512a168f4322]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:05 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 Sep 07 17:03:05 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:05 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0" returned: 0 in 0.418s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:05 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:05 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0 Sep 07 17:03:05 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:06 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-4dd03eac-40de-406c-999e-111d43445db0" returned: 0 in 0.283s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Lock "cinder-quobyte-4dd03eac-40de-406c-999e-111d43445db0" released by "delete_volume" :: held 0.758s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Created reservations ['d2be80ff-be3f-4822-b9e3-49b5b2416797', '05c38e58-c7b7-420e-9c51-9d4dd79d8c80', '8317a3fd-7a0a-4af3-93fa-d1f2c79c213b', '733c2372-a210-4257-b10e-c162c421e1a8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:06 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:03:06 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:06 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.256s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:03:06 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Deleted volume successfully. Sep 07 17:03:06 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-84ae8c48-99c9-40ab-b05e-72df1dfdcc39 tempest-ProjectMemberTests-775595433 None] Lock "cinder-4dd03eac-40de-406c-999e-111d43445db0-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:16 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=36,cinder:INSERT=15,cinder:DELETE=3,cinder:UPDATE=50 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:03:16 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=41,cinder:UPDATE=50,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:33 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:03:33 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:33 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.284s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG oslo_service.periodic_task [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87492) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread count: 29 {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:03:33 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0889e368-544c-4df4-bb67-06bf881853d2 None None] thread info: [<_MainThread(MainThread, started 123750483107968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87492) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Flow 'volume_create_manager' (834007a2-f224-4be6-aaa2-ee512944c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a9b7d2-6d3c-48cb-b0df-fa474d2d1aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a9b7d2-6d3c-48cb-b0df-fa474d2d1aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1597109212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb374e06-f904-4628-ba4d-e7929b0684da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43b239f2bb849aba6fbc382afe6289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:34Z,use_quota=True,user_id='b9a2c35b2c9c47aabe22d0db015853dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f0cf52-31d7-46a0-b3fc-8cff68d15559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f0cf52-31d7-46a0-b3fc-8cff68d15559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590dbd61-fbf3-4630-a6c5-8c5c1d7c5025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590dbd61-fbf3-4630-a6c5-8c5c1d7c5025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb374e06-f904-4628-ba4d-e7929b0684da', 'volume_name': 'volume-bb374e06-f904-4628-ba4d-e7929b0684da', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8046d6e2-6cae-46fe-adaa-ba2d5e95dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8046d6e2-6cae-46fe-adaa-ba2d5e95dafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c76c57-f66f-4e07-bd8d-c5bdee3417d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:34 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Volume bb374e06-f904-4628-ba4d-e7929b0684da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb374e06-f904-4628-ba4d-e7929b0684da', 'volume_size': 1} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1597109212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb374e06-f904-4628-ba4d-e7929b0684da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43b239f2bb849aba6fbc382afe6289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:34Z,use_quota=True,user_id='b9a2c35b2c9c47aabe22d0db015853dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)}" {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Creating volume bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:03:34 devstack cinder-volume[87492]: INFO cinder.volume.drivers.remotefs [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] casted to osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da 1073741824 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:34 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da 1073741824 Sep 07 17:03:34 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:34 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da 1073741824" returned: 0 in 0.432s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:34 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:34 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da Sep 07 17:03:34 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:35 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da" returned: 0 in 0.233s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'} {{(pid=87492) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c76c57-f66f-4e07-bd8d-c5bdee3417d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb374e06-f904-4628-ba4d-e7929b0684da', 'volume_size': 1}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2906058-6065-4071-b212-1b62dfd5d5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:35 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Volume volume-bb374e06-f904-4628-ba4d-e7929b0684da (bb374e06-f904-4628-ba4d-e7929b0684da): created successfully Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2906058-6065-4071-b212-1b62dfd5d5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Flow 'volume_create_manager' (834007a2-f224-4be6-aaa2-ee512944c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:35 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-5e2a1f67-0f05-450d-a2c2-69d136c39462 tempest-SnapshotDependencyTests-100099356 None] Created volume successfully. Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Creating offline snapshot 5d0c0081-f6d6-4dbf-9e65-0875104131ea of volume bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[29397c36-3504-40f2-9096-aef37751861a]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:35 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da Sep 07 17:03:35 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:35 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da" returned: 0 in 0.352s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:35 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea 1G {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:35 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea 1G Sep 07 17:03:35 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:36 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea 1G" returned: 0 in 0.373s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb374e06-f904-4628-ba4d-e7929b0684da -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:36 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb374e06-f904-4628-ba4d-e7929b0684da -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea Sep 07 17:03:36 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:36 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb374e06-f904-4628-ba4d-e7929b0684da -F qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea" returned: 0 in 0.301s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:36 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea is being set with open permissions: ugo+rw Sep 07 17:03:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:36 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea Sep 07 17:03:36 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:36 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea" returned: 0 in 0.268s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:36 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:36 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.info Sep 07 17:03:36 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:37 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.info" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:37 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.info is being set with open permissions: ugo+rw Sep 07 17:03:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.info {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:37 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.info Sep 07 17:03:37 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:37 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.info" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:37 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:37 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-172e7440-ca1a-4c8e-9353-ee9f21717f4a tempest-SnapshotDependencyTests-100099356 None] Create snapshot completed successfully Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87492) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Flow 'volume_create_manager' (97d4acd0-4b17-4dd8-8b46-eb71dd59de37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1358cb-2a3b-433d-a679-3e795beaf54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1358cb-2a3b-433d-a679-3e795beaf54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d43b239f2bb849aba6fbc382afe6289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d0c0081-f6d6-4dbf-9e65-0875104131ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:38Z,use_quota=True,user_id='b9a2c35b2c9c47aabe22d0db015853dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb1ff13-2da6-43b2-a55f-3a96172b3b20),volume_type_id=2bb1ff13-2da6-43b2-a55f-3a96172b3b20)' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9d3e09-d111-4791-9360-bada102db476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9d3e09-d111-4791-9360-bada102db476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dbe6f0-5680-4af0-9312-d300b63d211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dbe6f0-5680-4af0-9312-d300b63d211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a', 'volume_name': 'volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a', 'volume_size': 1, 'snapshot_id': '5d0c0081-f6d6-4dbf-9e65-0875104131ea'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403adc46-2306-40a0-b2f6-07c482dbd9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403adc46-2306-40a0-b2f6-07c482dbd9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e19d70-be9e-4a0c-9de5-66107f177902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:38 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Volume fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a', 'volume_size': 1, 'snapshot_id': '5d0c0081-f6d6-4dbf-9e65-0875104131ea'} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-quobyte-5d0c0081-f6d6-4dbf-9e65-0875104131ea-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" by "_create_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-5d0c0081-f6d6-4dbf-9e65-0875104131ea-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Creating volume fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a from snapshot 5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Selected osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d as target Quobyte volume. {{(pid=87492) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-quobyte-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" by "_copy_volume_from_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] snapshot: 5d0c0081-f6d6-4dbf-9e65-0875104131ea, volume: fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a, {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d678981-ec29-473d-96c6-8a6877125b8d]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:38 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea Sep 07 17:03:38 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:38 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea" returned: 0 in 0.367s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb374e06-f904-4628-ba4d-e7929b0684da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec745b-d240-4470-854e-17ea330e7665]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:38 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:38 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da Sep 07 17:03:38 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:39 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da" returned: 0 in 0.396s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:03:39 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Creating direct copy from snapshot {{(pid=87492) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:03:39 devstack cinder-volume[87492]: DEBUG cinder.utils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Path /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a not found in is_blk_device check {{(pid=87492) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:03:39 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:39 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a Sep 07 17:03:39 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:43 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" returned: 0 in 4.000s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.image.image_utils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Image conversion details: src /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a {{(pid=87492) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:03:43 devstack cinder-volume[87492]: INFO cinder.image.image_utils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Converted 1024.00 MB image at 255.96 MB/s Sep 07 17:03:43 devstack cinder-volume[87492]: WARNING cinder.volume.drivers.remotefs [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a is being set with open permissions: ugo+rw Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:43 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a Sep 07 17:03:43 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:43 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" returned: 0 in 0.228s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" released by "_copy_volume_from_snapshot" :: held 5.073s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-5d0c0081-f6d6-4dbf-9e65-0875104131ea-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" released by "_create_volume_from_snapshot" :: held 5.135s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.149s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e19d70-be9e-4a0c-9de5-66107f177902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a', 'volume_size': 1, 'snapshot_id': '5d0c0081-f6d6-4dbf-9e65-0875104131ea'}' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea05ed3-5040-4bfb-ae39-c55aaa45510a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:43 devstack cinder-volume[87492]: INFO cinder.volume.flows.manager.create_volume [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Volume volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a (fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a): created successfully Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea05ed3-5040-4bfb-ae39-c55aaa45510a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87492) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Flow 'volume_create_manager' (97d4acd0-4b17-4dd8-8b46-eb71dd59de37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87492) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:43 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-0a98a1da-a385-4648-8709-d8db193b4d89 tempest-SnapshotDependencyTests-100099356 None] Created volume successfully. Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-5d0c0081-f6d6-4dbf-9e65-0875104131ea-delete_snapshot" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-5d0c0081-f6d6-4dbf-9e65-0875104131ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-quobyte-bb374e06-f904-4628-ba4d-e7929b0684da" by "delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-bb374e06-f904-4628-ba4d-e7929b0684da" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-quobyte-5d0c0081-f6d6-4dbf-9e65-0875104131ea" by "_delete_snapshot" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-5d0c0081-f6d6-4dbf-9e65-0875104131ea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Deleting offline snapshot 5d0c0081-f6d6-4dbf-9e65-0875104131ea of volume bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] snapshot_file for this snap is: volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0f76ee-e57a-4e75-90c0-79e5feabc4cd]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:43 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:43 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea Sep 07 17:03:43 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:44 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea" returned: 0 in 0.337s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:44 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.remotefs [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb374e06-f904-4628-ba4d-e7929b0684da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87492) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:44 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabf0953-25ea-4d1b-8ad6-6732aefbce5e]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:44 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da Sep 07 17:03:44 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:44 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da" returned: 0 in 0.494s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:44 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:44 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea Sep 07 17:03:44 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:45 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea" returned: 0 in 0.314s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:45 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea Sep 07 17:03:45 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:45 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:45 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da.5d0c0081-f6d6-4dbf-9e65-0875104131ea" returned: 0 in 0.240s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-5d0c0081-f6d6-4dbf-9e65-0875104131ea" released by "_delete_snapshot" :: held 1.475s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-bb374e06-f904-4628-ba4d-e7929b0684da" released by "delete_snapshot" :: held 1.498s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:45 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Created reservations ['69145c9e-26b0-43b2-ba89-a2733e896f85', '293146b8-e434-4632-bdac-87a51f3d25c1', '2b440bc8-a974-46ee-8a7d-3f61791813cc', '4c7bace1-1922-4ee2-bf4e-e72c17ab6fb8'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:45 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Delete snapshot completed successfully. Sep 07 17:03:45 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-051432eb-fad0-4b2f-b51b-c0b9fe7ecdf0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-5d0c0081-f6d6-4dbf-9e65-0875104131ea-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-bb374e06-f904-4628-ba4d-e7929b0684da-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-bb374e06-f904-4628-ba4d-e7929b0684da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-quobyte-bb374e06-f904-4628-ba4d-e7929b0684da" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-bb374e06-f904-4628-ba4d-e7929b0684da" acquired by "delete_volume" :: waited 0.016s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a9045d-8ebe-4ee0-8a75-91fd1747b89b]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:46 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da Sep 07 17:03:46 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:46 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da" returned: 0 in 0.352s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:46 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da Sep 07 17:03:46 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:46 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-bb374e06-f904-4628-ba4d-e7929b0684da" returned: 0 in 0.248s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-bb374e06-f904-4628-ba4d-e7929b0684da" released by "delete_volume" :: held 0.652s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Created reservations ['cff580ed-8d17-492a-a799-9a38f124d141', '1a264b3a-994f-4edf-9851-b9d05643ca77', '13b186eb-9203-40a2-b3d2-787957e0c52d', '6d62177c-74f5-425e-9019-37751d2bc1fa'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:46 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:46 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:03:46 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:47 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a-delete_volume" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.257s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:03:47 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Deleted volume successfully. Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-f2c1334f-2f8c-47ad-b557-26005825bb0d tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-bb374e06-f904-4628-ba4d-e7929b0684da-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "cinder-quobyte-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" by "delete_volume" {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" acquired by "delete_volume" :: waited 0.020s {{(pid=87492) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG oslo.privsep.daemon [-] privsep: reply[3964ab5f-797b-4578-9826-0d818968b034]: (4, 'qcow2') {{(pid=88861) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:47 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a Sep 07 17:03:47 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:47 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" returned: 0 in 0.356s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:47 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a Sep 07 17:03:47 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:47 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187/volume-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" returned: 0 in 0.258s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-quobyte-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a" released by "delete_volume" :: held 0.653s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:47 devstack cinder-volume[87492]: DEBUG cinder.quota [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Created reservations ['1e88e3a2-1dd1-45b0-944d-331b6f9cd4b7', '4e014e5e-b932-4a70-9d87-6483d331c679', '332d3491-ff45-4730-a897-19d16b807dc6', '31f46324-f1fd-4d3a-847e-ba1934ad842a'] {{(pid=87492) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d': None} {{(pid=87492) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG cinder.volume.drivers.quobyte [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9ba7c2b3-cef7-4020-9cff-e0f1e3bbb10d'] {{(pid=87492) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.lockutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87492) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:48 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187 Sep 07 17:03:48 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:48 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG oslo_concurrency.processutils [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d0017b2bb69daf78c17887cf17136187" returned: 0 in 0.263s {{(pid=87492) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG cinder.manager [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Notifying Schedulers of capabilities ... {{(pid=87492) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:03:48 devstack cinder-volume[87492]: INFO cinder.volume.manager [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Deleted volume successfully. Sep 07 17:03:48 devstack cinder-volume[87492]: DEBUG cinder.coordination [None req-8f063373-979d-479c-b7f5-0374f5d5dba0 tempest-SnapshotDependencyTests-100099356 None] Lock "cinder-fb04e3b0-1ac5-40fa-9bd8-f03aa7726a7a-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87492) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:UPDATE=29,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:04:00 devstack cinder-volume[87492]: DEBUG dbcounter [-] [87492] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=87492) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}